-- Logs begin at Mon 2022-08-29 23:04:29 UTC, end at Tue 2022-08-30 00:20:51 UTC. -- Aug 29 23:50:56.896817 dv-cinder-854273-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 23:50:56.907001 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:50:56 2022] *** Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: nodename: dv-cinder-854273-4-iscsi Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: machine: x86_64 Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: clock source: unix Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: pcre jit disabled Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: detected number of CPU cores: 4 Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: current working directory: / Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: your processes number limit is 47680 Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: your memory page size is 4096 bytes Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: detected max file descriptor number: 2048 Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: lock engine: pthread robust mutexes Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: thunder lock: enabled Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 23:50:56.909131 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:50:56.948051 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: Python main interpreter initialized at 0x555a49a9e9c0 Aug 29 23:50:56.948051 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: python threads support enabled Aug 29 23:50:56.948051 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: your server socket listen backlog is limited to 100 connections Aug 29 23:50:56.948051 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:50:56.948416 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:50:56.948502 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: *** Operational MODE: preforking *** Aug 29 23:50:56.948741 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:50:56.948741 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: spawned uWSGI master process (pid: 112332) Aug 29 23:50:56.948934 dv-cinder-854273-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 23:50:56.949960 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: spawned uWSGI worker 1 (pid: 112333, cores: 1) Aug 29 23:50:56.949960 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: spawned uWSGI worker 2 (pid: 112334, cores: 1) Aug 29 23:50:56.949960 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:50:57.608862 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:50:57.609474 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:50:58.694592 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:58.694592 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: from cryptography.utils import int_from_bytes Aug 29 23:50:58.695286 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:58.695286 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: from cryptography.utils import int_from_bytes Aug 29 23:50:58.696673 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:58.696673 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: from cryptography.utils import int_from_bytes Aug 29 23:50:58.697121 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:58.697121 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: from cryptography.utils import int_from_bytes Aug 29 23:51:01.185241 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:51:01.186091 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:51:01.186091 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:51:01.186435 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:51:01.186607 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:51:01.186948 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.187271 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.187589 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.187901 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.188228 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.188543 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.188862 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.189173 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.189496 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.189759 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.190068 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.190394 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-4-iscsi {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.190666 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:51:01.191164 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.191329 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:51:01.191479 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.191479 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.191748 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:51:01.192020 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.192177 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:51:01.192333 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.192457 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:51:01.192543 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.192680 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.192779 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.192870 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.192984 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.193100 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.193317 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.193507 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.193703 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.193901 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.194104 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.194304 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.194571 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.194711 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.194928 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.195058 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.195221 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.195390 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.195597 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.195818 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.196015 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.196224 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.196420 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-4-iscsi {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.196628 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.196831 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.197051 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.197257 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.197257 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.197644 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-4-iscsi {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.197847 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.197987 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.198628 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.198766 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.198894 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199007 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199140 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199277 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199277 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199522 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199666 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199805 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.199805 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200050 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200174 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200298 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200420 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200553 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200681 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200806 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.200937 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201070 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201194 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201336 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201469 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201594 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201718 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201850 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.201976 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.202102 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.202102 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.202347 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-4-iscsi {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.202510 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.202639 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.202763 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.202899 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203037 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203164 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203287 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203541 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203666 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203799 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.203937 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.204063 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.204188 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.204341 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.204513 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.204654 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.204813 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.204953 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.205125 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.205254 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.205435 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.205572 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.205737 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.205873 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.206043 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.206172 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.206335 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.206463 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.206664 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.206792 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.206965 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.207105 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.207264 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.207403 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.207566 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.207696 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.207868 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.208006 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.208175 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.208302 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.208479 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.208614 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.208794 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.208934 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.209099 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.209227 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.209411 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.209549 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.209725 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.209862 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.209995 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.210121 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.210244 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.210368 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.210525 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.210655 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.210787 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.210976 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.211109 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.211282 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.211420 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.211594 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.211723 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.211910 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.212039 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.212220 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.212350 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.212518 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.212656 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.212819 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.212945 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.213132 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.213276 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.213457 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.213595 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.213809 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.214454 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.214623 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.214750 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.214875 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.214999 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.215175 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.215354 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.215492 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.215625 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.215781 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.215910 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.216086 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.216368 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.216498 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.216673 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.216859 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.216988 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.217169 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.217307 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.217485 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.217622 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.217802 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.217931 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.218106 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.218244 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.218408 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.218585 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.218721 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.218854 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.219028 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.219165 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.219328 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.219466 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.219633 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.219760 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.219896 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.220030 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.220155 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.220279 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.220446 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.220575 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.220779 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.220908 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.221033 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.221171 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.221330 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.221458 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.221632 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.221771 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.221927 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.222062 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.222226 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.222361 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.222546 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.222678 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.222848 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.222978 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.223146 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.223275 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.223445 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.223575 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.223742 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.223872 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.224044 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.224174 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.224340 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.224477 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.224635 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.224766 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.224945 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.225080 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.225251 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.225380 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.225548 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.225676 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.225845 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.225982 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.226142 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.226279 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.226438 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.226629 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.226755 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.226886 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.227044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.227166 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.227344 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.227473 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.227640 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.227772 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.227939 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.228077 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.228236 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.228366 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.228544 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.228687 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.228846 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.228974 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.229145 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.229271 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.229480 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.229617 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.229774 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.229904 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.230074 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.230202 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.230382 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.230541 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.230703 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.230834 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.230999 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.231129 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.231294 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.231427 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.231588 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.231717 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.231881 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.232018 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.232175 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.232306 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.232469 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.232599 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.232763 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.232896 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.233035 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.233200 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.233349 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.233509 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.233660 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.233808 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.233962 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.234129 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.234269 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.234454 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.234650 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.234788 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.234916 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:51:01.235092 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.235207 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.235410 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.235531 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.235717 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.235857 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.236033 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.236170 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.236359 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.236498 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.236679 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.236816 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.236987 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.237136 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.237321 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.237449 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.237661 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.237801 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.237974 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.238102 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.238296 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.238426 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.238640 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.238779 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.238946 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.239083 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.239255 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.239392 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.239564 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.239694 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.239883 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.240020 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.240193 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.240331 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.240503 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.240639 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.240815 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.240946 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.241119 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.241330 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.241466 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.241592 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.241739 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.241864 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.242029 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.242169 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.242331 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.242459 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.242669 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.242798 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.242978 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.243125 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.243310 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.243437 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.243623 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.243750 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.243937 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.244071 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.244244 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.244375 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.244548 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.244678 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.244851 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.244983 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.245187 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.245317 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.245498 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.245619 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.245809 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.245983 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.246122 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.246257 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.246405 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.246589 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.246719 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.246853 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.247033 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.247149 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.247398 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.247534 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.247691 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.247807 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.248020 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.248135 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.248322 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.248458 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.248652 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.248767 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.248956 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.249071 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.249265 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.249406 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.249572 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.249700 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.249879 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.249992 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.250179 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.250317 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.250522 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.250657 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.250817 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.250946 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.251120 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.251251 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.251416 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.251544 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.251716 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.251853 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.252018 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.252148 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.252323 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.252454 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.252624 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.252787 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.252926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.253060 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.253227 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.253365 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.253533 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.253661 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.253843 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.253972 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.254150 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.254285 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.254456 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.254600 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.254800 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.254929 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.255113 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.255247 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.255425 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.255603 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.255732 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.255839 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.256038 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.256153 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.256339 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.256462 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.256662 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.256791 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.256968 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.257099 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.257270 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.257408 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.257581 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.257697 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.257878 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.257990 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.258181 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.258354 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.258558 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.258690 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.258828 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.259089 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.259227 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.259390 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.259520 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.259699 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.259829 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.259978 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.260117 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.260279 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.261108 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.261250 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.261427 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.261564 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.261732 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.261874 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.262033 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.262161 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.262332 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.262558 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.262690 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.262992 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.263122 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.263295 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.263633 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.263770 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.263967 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.264226 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.264362 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.264589 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.264792 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.264937 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.265202 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.265355 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.265510 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.265821 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.265950 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.266132 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.266263 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.266442 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.266603 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.266777 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.266904 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.267069 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.267200 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.267379 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.267508 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.267683 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.267825 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.267985 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.268117 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.268287 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.268403 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.268588 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.268727 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.268892 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.269021 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.269196 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.269325 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.269498 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.269637 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.269798 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.269927 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.270098 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.270229 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.270436 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.270613 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.270764 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.270903 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.271076 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.271211 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.271424 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.271562 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.271689 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.271813 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.271977 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.272115 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.272286 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.272419 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.272607 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.272736 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.272916 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.273045 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.273222 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.273337 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.273526 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.273654 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.273846 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.273960 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.274153 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.274269 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.274488 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.274607 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.274791 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.274935 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.275103 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.275232 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.275432 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.275561 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.275762 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.275901 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.276072 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.276244 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.276934 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.277056 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.277252 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.277392 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.277562 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.277694 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.277951 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.278295 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.278412 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.278560 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.278682 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.278809 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.278938 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.279072 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.279243 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.279374 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.279657 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.279786 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.279963 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.280146 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.280284 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.280463 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.280601 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.281079 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.281211 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.281395 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.281533 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.281697 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.281957 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.282095 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.282314 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.282548 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.282694 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.282964 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.283093 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.283282 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.283586 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.283714 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.283889 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.284207 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.284335 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.284514 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.284711 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.284849 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.285044 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.285174 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.285356 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.285471 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.285677 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.285807 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.286013 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.286150 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.286324 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.286455 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.286657 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.286785 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.286977 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.287094 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.287286 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.287425 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.287602 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.287727 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.287912 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.288036 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.288219 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.288335 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.288538 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.288661 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.288841 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.288954 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.289147 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.289263 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.289455 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.289570 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.289760 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.289889 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.290065 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.290196 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.290366 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.290577 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.290715 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.290842 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.290997 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.291133 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.291298 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.291429 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.291596 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.291734 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.291926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.292063 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.292236 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.292375 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.292551 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.292681 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.292912 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.293143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.293285 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.293479 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.293609 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.293793 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.293922 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.294109 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.294240 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.294415 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.294569 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.294741 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.294872 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.295043 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.295192 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.295350 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.295481 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.295690 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.295820 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.295997 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.296137 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.296316 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.296447 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.296620 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.296750 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.296923 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.297061 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.297230 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.297346 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.297534 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.297662 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.297836 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.297968 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.298136 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.298266 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.298442 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.298596 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.298775 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.298905 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.299076 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.299205 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.299376 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.299506 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.299759 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.299888 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300021 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300148 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300280 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300406 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300541 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300669 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300845 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.300975 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.301157 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.301295 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.301461 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.301589 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.301757 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.301892 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.302057 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.302198 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.302361 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.302547 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.302733 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.302955 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.303086 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.303348 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.303487 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.303746 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.303893 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.304031 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.304156 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.304292 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.304418 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.304594 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.304724 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.304916 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.305056 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.305220 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.305360 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.305523 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.305653 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.305824 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.305955 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.306131 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.306261 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.306438 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.306586 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.306762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.306904 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.307070 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.307201 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.307397 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.307521 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.307709 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.307838 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.308017 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.308148 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.308318 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.308448 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.308619 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.308746 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.308920 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.309051 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.309217 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.309344 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.309533 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.309672 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.309832 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.309939 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.310123 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.310259 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.310431 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.310596 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.310763 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.310892 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.311066 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.311198 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.311366 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.311505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.311667 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.311795 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.311981 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.312184 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.312315 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.312572 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.312702 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.312879 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.313149 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.313280 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.313479 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.313595 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.313783 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.314106 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.314239 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.314415 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.314629 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.314761 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.315040 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.315169 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.315348 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.315599 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.315762 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.315942 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.316071 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.316250 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.316539 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.316677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.316871 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.317000 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.317173 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.317453 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.317592 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.317771 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.317902 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.318074 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.318374 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.318553 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.318705 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.318903 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.319034 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.319292 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.319420 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.319591 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.319851 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.319983 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.320178 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.320307 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.320498 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.320738 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.320868 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.321090 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.321220 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.321391 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.321659 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.321799 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.322021 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.322150 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.322323 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.322603 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.322738 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.323517 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.323662 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.323840 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.324076 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.324205 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.324457 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.324585 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.324767 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.324989 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.325119 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.325368 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.325495 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.325679 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.325915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.326054 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.326287 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.326414 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.326623 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.326862 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.327002 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.327230 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.327369 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.327541 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.327794 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.327931 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.328156 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.328296 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.328475 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.328700 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.328829 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.329082 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.329213 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.329389 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.329608 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.329738 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.329992 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.330122 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.330298 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.330556 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.330759 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.330936 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.331080 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.331248 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.331493 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.331623 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.331857 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.332069 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.332283 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.332483 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.332687 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.332894 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.333068 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.333212 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.333350 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.333484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.333648 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.333778 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.333955 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.334184 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.334408 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.334635 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.334832 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.334982 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.335156 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.335304 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.335455 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.335616 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.335904 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.336136 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.336353 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.336567 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.336767 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.336905 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.337034 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.337160 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.337395 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.337536 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.337711 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.337865 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.338027 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.338330 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.338460 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.339330 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.339468 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.339648 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.339959 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.340090 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.340270 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.340489 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.340621 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.340865 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.341018 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.341175 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.341499 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.341629 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.341802 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.342093 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.342236 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.342394 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.342667 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.342809 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.343032 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.343192 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.343356 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.343720 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.343862 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.344072 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.344334 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.344464 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.344779 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.344920 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.345381 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.345381 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.345624 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.345765 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.345893 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.346029 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.346156 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.346316 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.346517 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.346652 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.346808 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.346954 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.347125 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.347255 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.347440 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.347570 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.347747 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.347888 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.348071 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.348187 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.348386 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.348518 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.348700 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.348840 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.349004 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.349145 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.349307 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.349446 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.349630 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.349747 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.349944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.350084 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.350256 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.350401 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.350610 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.350751 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.350933 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.351072 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.351255 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.351388 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.351557 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.351698 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.351867 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.351998 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.352177 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.352306 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.352483 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.352621 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.352790 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.352920 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.353142 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.353280 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.353464 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.353756 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.353893 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.354066 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.354196 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.354406 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.355232 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.355388 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.355388 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.355613 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.355740 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.355882 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.356011 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.356136 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.356629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.356763 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.356889 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357030 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357158 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357266 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357382 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357511 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357630 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357739 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357846 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.357973 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358095 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358212 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358321 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358427 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358579 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358691 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358798 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.358904 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.359010 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.359245 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.359373 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.359556 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.359671 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.359865 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.359988 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.360168 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.360292 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.360476 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.360599 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.360786 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.360902 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.361102 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.361226 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.361415 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.361531 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.361715 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.361829 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.362068 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.362183 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.362392 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.362553 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.362719 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.362862 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.363021 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.363154 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.363325 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.363461 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.363623 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.363754 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.363923 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.364058 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.364226 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.364356 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.364524 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.364661 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.364803 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.364930 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.365107 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.365238 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.365406 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.365547 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.365706 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.365835 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.366013 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.366148 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.366330 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.366497 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.366663 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.366806 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.366968 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.367099 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.367270 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.367474 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.367608 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.367783 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.367914 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.368096 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.368236 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.368415 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.368546 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.368733 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.368874 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.369051 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.369179 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.369352 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.369476 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.369662 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.369792 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.370003 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.370145 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.370322 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.370452 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.370659 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.370787 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.370958 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.371099 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.371267 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.371388 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.371566 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.371696 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.371991 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.372181 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.372181 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.372406 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.372529 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.372655 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.372789 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.373059 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.373190 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.373396 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.373526 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.373709 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.373852 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.374022 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.374153 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.374335 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.374497 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.374676 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.374820 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.374984 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.375115 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.375288 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.375432 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.375570 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.375697 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.375871 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.376001 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.376188 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.376318 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.376485 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.376616 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.376791 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.376929 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.377096 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.377226 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.377397 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.377538 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.377680 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.377808 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.377994 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.378128 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.378293 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.378424 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.378613 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.378742 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.378911 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.379122 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.379265 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.379400 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.379527 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.379661 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.379819 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.379957 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.380115 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.380246 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.380429 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.380560 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.380731 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.380862 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.381029 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.381160 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.381328 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.381460 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.381626 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.381757 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.381962 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.382100 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.382261 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.382392 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.382596 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.382728 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.382918 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.383046 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.383238 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.383366 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.383542 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.383674 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.383869 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.384000 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.384180 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.384317 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.384492 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.384624 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.384831 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.384979 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.385192 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.385334 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.385986 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.386137 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.386303 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.386551 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.386684 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.386883 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.387012 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.387138 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.387271 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.387397 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.387542 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.387709 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.387840 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.388036 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.388165 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.388341 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.388480 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.388639 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.388770 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.388946 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.389082 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.389246 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.389383 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.389547 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.389676 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.389849 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.389977 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.390149 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.390288 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.390447 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.390606 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.390765 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.390898 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.391080 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.391217 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.391387 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.391618 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.391750 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.391970 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.392114 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.392289 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.392419 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.392667 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.392797 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.392925 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.393060 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.393209 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.393340 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.393520 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.393649 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.393928 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.394078 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.394206 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.394332 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.394457 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.394635 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.394775 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.394909 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.395037 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.395163 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.395344 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.395473 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.395648 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.395779 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.395959 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.396194 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.396324 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.396518 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.396657 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.396825 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.396955 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.397131 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.397261 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.397435 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.397573 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.397743 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.397872 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.398046 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.398183 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.398351 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.398506 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.398690 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.398820 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.398997 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.399129 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.399302 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.399434 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.399606 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.399735 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.399907 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.400037 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.400218 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.400351 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.400521 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.400650 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.400828 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.400971 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.401148 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.401778 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.401991 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.402121 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.402295 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.402435 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.402609 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.402754 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.402963 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.403093 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.403286 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.403427 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.403590 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.403719 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.403895 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.404031 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.404204 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.404336 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.404510 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.404639 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.404814 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.404950 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.405122 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.405262 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.405430 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.405562 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.405986 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.406117 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.406289 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.406421 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.406620 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.406872 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.407013 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.407203 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.407343 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.407525 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.407666 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.407851 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.407979 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.408160 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.408294 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.408468 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.408590 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.408771 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.408909 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.409072 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.409280 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.409418 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.409589 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.409740 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.409902 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.410039 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.410220 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.410350 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.410574 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.410720 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.410891 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.411020 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.411197 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.411328 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.411504 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.411636 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.411813 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.411936 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.412120 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.412249 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.412426 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.412554 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.412729 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.412862 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.413029 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.413157 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.413333 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.413461 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.413634 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.413772 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.413933 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.414070 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.414246 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.414386 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.414570 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.414713 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.414902 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.415098 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.415229 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.415440 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.415572 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.415754 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.415893 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.416072 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.416202 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.416405 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.416535 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.416684 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.416835 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.417025 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.417170 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.417353 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.417485 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.417664 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.417786 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.417967 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.418112 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.418311 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.418447 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.418648 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.418777 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.418949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.419092 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.419248 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.419382 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.419554 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.419683 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.419857 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.419995 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.420155 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.420294 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.420458 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.420597 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.420761 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.420891 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.421082 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.421220 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.421384 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.421515 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.421683 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.421814 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.421983 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.422120 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.422291 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.422420 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.422630 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.422762 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.422931 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.423052 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.423233 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.423372 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.423532 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.423663 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.423838 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.423974 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.424137 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.424281 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.424441 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.424570 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.424737 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.424872 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.425039 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.425176 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.425336 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.425473 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.425635 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.425764 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.425935 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.426074 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.426237 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.426368 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.426567 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.426699 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.426871 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.427005 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.427172 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.427302 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.427472 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.427604 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.427771 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.427903 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.428070 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.428199 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.428367 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.428497 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.428671 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.428803 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.428972 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.429101 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.429273 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.429568 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.429712 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.429866 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.429995 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.430164 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.430293 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.430509 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.430644 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.430842 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.430973 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.431141 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.431270 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.431442 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.431572 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.431739 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.431869 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.432053 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.432174 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.432355 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.432512 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.432683 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.432812 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.432987 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.433117 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.433290 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.433431 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.433594 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.433729 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.433895 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.434037 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.434196 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.434326 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.434519 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.434651 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.434825 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.434969 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.435130 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.435259 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.435429 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.435557 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.435732 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.435875 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.436035 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.436165 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.436334 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.436472 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.436640 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.436770 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.436960 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.437089 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.437274 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.437408 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.437585 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.437716 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.437896 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.438025 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.438205 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.438333 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.438532 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.438664 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.438836 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.438965 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.439138 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.439284 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.439440 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.439570 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.439749 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.439877 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.440059 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.440199 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.440363 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.440492 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.440660 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.440789 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.440968 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.441109 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.441284 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.441414 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.441598 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.441736 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.441926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.442057 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.442252 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.442381 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.442583 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.442718 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.442948 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.443087 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.443277 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.443414 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.443628 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.443757 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.443930 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.444066 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.444252 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.444390 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.444583 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.444792 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.444922 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.445048 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.445195 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.445326 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.445491 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.445628 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.445755 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:51:01.445880 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.446072 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.446373 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.446704 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.447008 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.447305 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.447603 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.447904 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.448715 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.449019 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.449315 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.449611 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.449910 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.450206 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.450525 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.450823 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.451120 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.451415 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.451709 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.452009 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.452305 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.452602 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.452897 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.453191 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.453485 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.453805 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.454128 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.454435 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.454778 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.455082 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.455395 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.455696 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.456008 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.456320 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.456628 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.456929 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.457253 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.457555 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.457860 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.458164 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.458477 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.459221 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.459221 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.459571 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.459809 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.460109 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.460426 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.460737 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.461052 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.461360 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.461664 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.461987 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.462292 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.462616 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.462921 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.463228 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.463532 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.464415 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.464723 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.465029 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.465341 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.465651 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.465973 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.466292 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.466623 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.466944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.467264 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.467605 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.467915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.468252 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.468574 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.468886 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.469191 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.469488 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:51:01.469727 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:51:01.598944 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO dbcounter [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Registered counter for database nova_api Aug 29 23:51:01.620888 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_db.sqlalchemy.engines [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.621728 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Registered counter for database nova_api Aug 29 23:51:01.627411 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writer thread running {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:01.643016 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.649518 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:01.686341 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.context [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03ce5c2-1a4b-434b-9dac-5218d9782043(cell1) {{(pid=112334) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:51:01.690193 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:01.690692 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:01.692281 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:01.693017 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:01.693460 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:01.695468 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:01.697528 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO dbcounter [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Registered counter for database nova_cell0 Aug 29 23:51:01.701687 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO dbcounter [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Registered counter for database nova_cell1 Aug 29 23:51:01.706536 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.context [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03ce5c2-1a4b-434b-9dac-5218d9782043(cell1) {{(pid=112333) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:51:01.708791 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_db.sqlalchemy.engines [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.710422 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:01.710914 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:01.711080 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_db.sqlalchemy.engines [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.712495 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:01.713217 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:01.714188 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:01.716218 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_concurrency.lockutils [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:01.716392 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writer thread running {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:01.718197 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Registered counter for database nova_cell0 Aug 29 23:51:01.721615 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writer thread running {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:01.722210 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Registered counter for database nova_cell1 Aug 29 23:51:01.729922 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.731646 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.737346 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:01.739621 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:01.863750 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO dbcounter [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Registered counter for database nova_cell0 Aug 29 23:51:01.872475 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_db.sqlalchemy.engines [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.876865 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writer thread running {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:01.883975 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO dbcounter [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Registered counter for database nova_cell0 Aug 29 23:51:01.892562 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG oslo_db.sqlalchemy.engines [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:51:01.897376 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writer thread running {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:51:02.289544 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: WARNING keystonemiddleware.auth_token [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:02.296907 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: WARNING keystonemiddleware.auth_token [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:02.308924 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:02.316132 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:02.647711 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: WARNING keystonemiddleware.auth_token [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:02.653653 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: WARNING keystonemiddleware.auth_token [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:02.653978 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:51:02.659236 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a49a9e9c0 pid: 112334 (default app) Aug 29 23:51:02.661353 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:02.662613 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001806 Aug 29 23:51:02.663039 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Mon Aug 29 23:51:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:02.667399 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: WARNING keystonemiddleware.auth_token [None req-74c8257b-02cb-4075-afd2-f6f039ed9bdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:51:02.673162 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a49a9e9c0 pid: 112333 (default app) Aug 29 23:52:23.758538 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:23.759705 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Aug 29 23:52:23.760198 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:23.772212 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=3 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:23.773601 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell0:SELECT=3 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:23.774552 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell1:SELECT=3 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:23.775735 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:24.698290 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-9aa771a1-75ee-43ab-bf1b-14cf12a239d9 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:24.729809 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-9aa771a1-75ee-43ab-bf1b-14cf12a239d9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.962625 Aug 29 23:52:24.730651 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Aug 29 23:52:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:27.109258 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:27.110344 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-5ac66050-4fd1-4254-8d6c-3524afe35dfe None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Aug 29 23:52:27.110977 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:27.534375 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-02532efb-b1c4-4da0-930b-2d685a5fda83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:27.638383 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-02532efb-b1c4-4da0-930b-2d685a5fda83 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521552 Aug 29 23:52:27.639174 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:52:27.653244 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_api:SELECT=3 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:27.654565 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_cell0:SELECT=3 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:27.655512 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_cell1:SELECT=3 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:27.656514 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:27.868297 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-552ff232-5f21-40a2-bd63-30dc5d8696cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:28.022000 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-552ff232-5f21-40a2-bd63-30dc5d8696cc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.374266 Aug 29 23:52:28.022940 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Aug 29 23:52:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:30.476574 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-02532efb-b1c4-4da0-930b-2d685a5fda83 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:30.477810 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-02532efb-b1c4-4da0-930b-2d685a5fda83 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Aug 29 23:52:30.478319 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:31.141784 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-2a308a33-a5b8-47ae-93e5-57b8547a3786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:31.298346 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-2a308a33-a5b8-47ae-93e5-57b8547a3786 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.813585 Aug 29 23:52:31.299048 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:52:31.311395 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-199ae166-b43e-4fa7-9bd0-721714b64398 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:31.384141 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-199ae166-b43e-4fa7-9bd0-721714b64398 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076640 Aug 29 23:52:31.384917 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Aug 29 23:52:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:33.742594 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-2a308a33-a5b8-47ae-93e5-57b8547a3786 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:33.743632 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-2a308a33-a5b8-47ae-93e5-57b8547a3786 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 29 23:52:33.744034 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:34.149250 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1ae9bdac-e2f2-443a-b9ee-7d1de931d7c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "name": "ds1G"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:34.219160 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1ae9bdac-e2f2-443a-b9ee-7d1de931d7c3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468799 Aug 29 23:52:34.219705 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:52:34.231935 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-80cffe4a-e6bb-4472-8286-d1d39c409809 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:34.301995 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-80cffe4a-e6bb-4472-8286-d1d39c409809 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073670 Aug 29 23:52:34.302649 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Aug 29 23:52:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:36.708599 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1ae9bdac-e2f2-443a-b9ee-7d1de931d7c3 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:36.710660 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1ae9bdac-e2f2-443a-b9ee-7d1de931d7c3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002347 Aug 29 23:52:36.711302 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:37.165125 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-9462c983-c180-4287-b5ef-7fe26fa05bde admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:37.243500 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-9462c983-c180-4287-b5ef-7fe26fa05bde admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.525063 Aug 29 23:52:37.244174 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:52:37.256541 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-7d4437e5-9c6b-4493-ac52-437def52abf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:37.343306 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-7d4437e5-9c6b-4493-ac52-437def52abf1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090500 Aug 29 23:52:37.343909 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Aug 29 23:52:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:39.735935 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-9462c983-c180-4287-b5ef-7fe26fa05bde admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:39.737658 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-9462c983-c180-4287-b5ef-7fe26fa05bde admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Aug 29 23:52:39.738589 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:40.172617 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-c56c9023-566d-4eda-8ad3-18b0101f0c67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:40.251319 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-c56c9023-566d-4eda-8ad3-18b0101f0c67 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506826 Aug 29 23:52:40.252190 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:52:40.264226 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-5a8cfa72-c96f-4012-b661-3feb1944ba6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:40.398080 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-5a8cfa72-c96f-4012-b661-3feb1944ba6e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136923 Aug 29 23:52:40.398745 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Aug 29 23:52:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:42.829618 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-c56c9023-566d-4eda-8ad3-18b0101f0c67 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:42.830684 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-c56c9023-566d-4eda-8ad3-18b0101f0c67 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 29 23:52:42.831099 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:43.251524 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-d08472c9-e9b8-4ff1-b61e-4cad9c2e3c51 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:43.275920 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-d08472c9-e9b8-4ff1-b61e-4cad9c2e3c51 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438221 Aug 29 23:52:43.276456 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Aug 29 23:52:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:45.661190 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-c56c9023-566d-4eda-8ad3-18b0101f0c67 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:45.662233 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-c56c9023-566d-4eda-8ad3-18b0101f0c67 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 29 23:52:45.663386 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:52:46.086858 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-b25b317c-e005-4a67-9362-bb267c59cd9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "id": "1"}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:46.161544 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-b25b317c-e005-4a67-9362-bb267c59cd9f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.489850 Aug 29 23:52:46.162098 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:52:46.176733 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-57ddd767-659e-41c5-8782-a8e959f9e796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:46.253526 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-57ddd767-659e-41c5-8782-a8e959f9e796 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080284 Aug 29 23:52:46.254268 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Aug 29 23:52:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:48.626823 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-b25b317c-e005-4a67-9362-bb267c59cd9f admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:48.627778 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-b25b317c-e005-4a67-9362-bb267c59cd9f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 29 23:52:48.628182 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:52:49.063207 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-0a9bbeaa-b15e-488e-bb37-af8f55537757 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "id": "2", "swap": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:49.127029 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-0a9bbeaa-b15e-488e-bb37-af8f55537757 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.492726 Aug 29 23:52:49.127714 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:52:49.140283 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-490b3f35-d455-422c-9220-3654f024d55b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:49.225861 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-490b3f35-d455-422c-9220-3654f024d55b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089263 Aug 29 23:52:49.226455 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Aug 29 23:52:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:51.744996 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-0a9bbeaa-b15e-488e-bb37-af8f55537757 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:51.744996 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-0a9bbeaa-b15e-488e-bb37-af8f55537757 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 29 23:52:51.744996 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:52.230505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-fa5f5044-7b5a-4cd4-a522-88ff65aedffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "disk": 40, "swap": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:52.548483 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-fa5f5044-7b5a-4cd4-a522-88ff65aedffd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.813045 Aug 29 23:52:52.549031 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:52:52.561783 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ad96929b-df2c-4155-a725-aede2c040eaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:52.662915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-ad96929b-df2c-4155-a725-aede2c040eaa admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104789 Aug 29 23:52:52.663496 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Aug 29 23:52:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:55.026304 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-fa5f5044-7b5a-4cd4-a522-88ff65aedffd admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:55.027397 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-fa5f5044-7b5a-4cd4-a522-88ff65aedffd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 29 23:52:55.027800 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:55.496806 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-5e491224-a339-48dd-b41f-05311c5e518f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:55.504146 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:55.593664 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-5e491224-a339-48dd-b41f-05311c5e518f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.558826 Aug 29 23:52:55.594405 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:52:55.606293 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-b073fefa-43d7-4138-9653-d9b65bbaecaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:55.713823 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-b073fefa-43d7-4138-9653-d9b65bbaecaa admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111227 Aug 29 23:52:55.714553 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Aug 29 23:52:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:58.163586 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-5e491224-a339-48dd-b41f-05311c5e518f admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:58.164700 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-5e491224-a339-48dd-b41f-05311c5e518f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 29 23:52:58.165185 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:58.591327 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-c39d69ae-f4da-4263-a8e1-7c73b95939a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:58.679733 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-c39d69ae-f4da-4263-a8e1-7c73b95939a8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.508098 Aug 29 23:52:58.680292 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Aug 29 23:52:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:52:58.692447 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-a65804c5-f977-402a-ad8c-ca43ac251687 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:58.777084 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-a65804c5-f977-402a-ad8c-ca43ac251687 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088353 Aug 29 23:52:58.778341 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Aug 29 23:52:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:17.719172 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-c39d69ae-f4da-4263-a8e1-7c73b95939a8 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:17.720191 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-c39d69ae-f4da-4263-a8e1-7c73b95939a8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 29 23:53:17.720595 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:18.109189 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-9d20cbd7-d387-4700-84bd-5a8b091912bf admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:18.128928 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-9d20cbd7-d387-4700-84bd-5a8b091912bf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401807 Aug 29 23:53:18.129468 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Aug 29 23:53:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:19.181668 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-c39d69ae-f4da-4263-a8e1-7c73b95939a8 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.182712 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-c39d69ae-f4da-4263-a8e1-7c73b95939a8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 29 23:53:19.183116 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:19.709873 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-61f2350d-b96f-4440-8dd5-2513fdc91008 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.715451 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.wsgi [None req-61f2350d-b96f-4440-8dd5-2513fdc91008 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-61f2350d-b96f-4440-8dd5-2513fdc91008 admin admin] Request method failure captured: Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Accept: application/json Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Accept-Encoding: gzip, deflate Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Connection: keep-alive Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Content-Length: 0 Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Host: 10.222.0.60 Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Openstack-Api-Version: compute 2.90 Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Openstack-System-Scope: None Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: User-Agent: python-novaclient Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Auth-Token: gAAAAABjDVFvJfU28Yemegv9Y6Ach_y5P0xgJfhfW1ddIXNppYepMwJSIMpXMs6-5pzvetyqsMHOPXZPfUjMViKOUfDJ6o8Q_O7RhnWxBUU9CAMpCRIPkoE31PE_vIMQa5TsMfJTPOr1p7bld7D1Vze-Kj4wKzHIO3OPHUnBFIuzJ5zBG2vNTuI Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Domain-Id: None Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Domain-Name: None Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Identity-Status: Confirmed Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Is-Admin-Project: True Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Domain-Id: default Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Domain-Name: Default Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Name: admin Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Role: member,reader,admin Aug 29 23:53:19.718762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Roles: member,reader,admin Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}] Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant: admin Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant-Name: admin Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User: admin Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Domain-Id: default Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Domain-Name: Default Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Id: 1c8e233e14fe4b94bbd97e9de03f0d21 Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Name: admin Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: method: > Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: exception: Flavor 42 could not be found. Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: action_args: {'id': '42'} Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:19.720410 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:19.721299 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.722450 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-61f2350d-b96f-4440-8dd5-2513fdc91008 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:19.724262 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-61f2350d-b96f-4440-8dd5-2513fdc91008 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401087 Aug 29 23:53:19.724262 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 23:53:19.730256 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-ff59171a-9aaa-4615-8c2e-93d8e15c4531 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.734448 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:19.754501 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-ff59171a-9aaa-4615-8c2e-93d8e15c4531 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027770 Aug 29 23:53:19.755236 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:19.764658 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-7f40cb6b-f4d5-4e5c-bb4b-9b33fe74cc54 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.787809 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-7f40cb6b-f4d5-4e5c-bb4b-9b33fe74cc54 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026707 Aug 29 23:53:19.788344 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:19.797982 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-54825671-47a5-485d-b91d-a7e148b9d9c2 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.803632 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.wsgi [None req-54825671-47a5-485d-b91d-a7e148b9d9c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-54825671-47a5-485d-b91d-a7e148b9d9c2 admin admin] Request method failure captured: Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Accept: application/json Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Accept-Encoding: gzip, deflate Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Connection: keep-alive Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Content-Length: 0 Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Host: 10.222.0.60 Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Openstack-Api-Version: compute 2.90 Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Openstack-System-Scope: None Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: User-Agent: python-novaclient Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Auth-Token: gAAAAABjDVFvJfU28Yemegv9Y6Ach_y5P0xgJfhfW1ddIXNppYepMwJSIMpXMs6-5pzvetyqsMHOPXZPfUjMViKOUfDJ6o8Q_O7RhnWxBUU9CAMpCRIPkoE31PE_vIMQa5TsMfJTPOr1p7bld7D1Vze-Kj4wKzHIO3OPHUnBFIuzJ5zBG2vNTuI Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Domain-Id: None Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Domain-Name: None Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Identity-Status: Confirmed Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Is-Admin-Project: True Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Domain-Id: default Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Domain-Name: Default Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Name: admin Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Role: member,reader,admin Aug 29 23:53:19.806926 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Roles: member,reader,admin Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}] Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant: admin Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant-Name: admin Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User: admin Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Domain-Id: default Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Domain-Name: Default Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Id: 1c8e233e14fe4b94bbd97e9de03f0d21 Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Name: admin Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: method: > Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: exception: Flavor 42 could not be found. Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: action_args: {'id': '42'} Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:19.808484 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:19.809677 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:19.815629 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-54825671-47a5-485d-b91d-a7e148b9d9c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:19.816730 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-54825671-47a5-485d-b91d-a7e148b9d9c2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014327 Aug 29 23:53:19.816730 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:20.794742 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-7f40cb6b-f4d5-4e5c-bb4b-9b33fe74cc54 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.795762 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-7f40cb6b-f4d5-4e5c-bb4b-9b33fe74cc54 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 29 23:53:20.796157 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:21.314822 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-e89fef35-f584-4c14-b6bb-075c6e97018a admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.321157 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.wsgi [None req-e89fef35-f584-4c14-b6bb-075c6e97018a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-e89fef35-f584-4c14-b6bb-075c6e97018a admin admin] Request method failure captured: Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Accept: application/json Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Accept-Encoding: gzip, deflate Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Connection: keep-alive Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Content-Length: 0 Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Host: 10.222.0.60 Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Openstack-Api-Version: compute 2.90 Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Openstack-System-Scope: None Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: User-Agent: python-novaclient Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Auth-Token: gAAAAABjDVFwXzq90vLWR_muB_W-DVOtPWzQ9Us12jDo8i2S_MY9lS76NFcHZCuKmZMgxH8QuTHY5PS3LRuDnoGFkRqSqDeXsT41o6ZCrqfbXhdhDisCIEVgt9FZ2-_WFY_oJfJ-RL_WE8rrrkn1TUehaPiYsxfeF5jZHKTlm8wHm-yI0fGdKKk Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Domain-Id: None Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Domain-Name: None Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Identity-Status: Confirmed Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Is-Admin-Project: True Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Domain-Id: default Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Domain-Name: Default Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Name: admin Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Role: member,reader,admin Aug 29 23:53:21.322703 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Roles: member,reader,admin Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}] Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant: admin Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant-Name: admin Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User: admin Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Domain-Id: default Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Domain-Name: Default Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Id: 1c8e233e14fe4b94bbd97e9de03f0d21 Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Name: admin Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: method: > Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: exception: Flavor 84 could not be found. Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: action_args: {'id': '84'} Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:21.324143 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:21.325044 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.326428 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-e89fef35-f584-4c14-b6bb-075c6e97018a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:21.327721 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-e89fef35-f584-4c14-b6bb-075c6e97018a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391315 Aug 29 23:53:21.327721 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:21.333782 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-ab22bdec-f26c-4552-bcee-030c9bed3898 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.348685 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-ab22bdec-f26c-4552-bcee-030c9bed3898 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018456 Aug 29 23:53:21.349219 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:21.358778 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-c3464b1b-84ed-4023-86bb-934b0a234f29 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.374297 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-c3464b1b-84ed-4023-86bb-934b0a234f29 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019098 Aug 29 23:53:21.374887 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:21.384193 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1793ff21-684a-48fd-ade0-e9a7b923413e admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.390378 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.wsgi [None req-1793ff21-684a-48fd-ade0-e9a7b923413e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1793ff21-684a-48fd-ade0-e9a7b923413e admin admin] Request method failure captured: Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Accept: application/json Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Accept-Encoding: gzip, deflate Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Connection: keep-alive Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Content-Length: 0 Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Host: 10.222.0.60 Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Openstack-Api-Version: compute 2.90 Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Openstack-System-Scope: None Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: User-Agent: python-novaclient Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Auth-Token: gAAAAABjDVFwXzq90vLWR_muB_W-DVOtPWzQ9Us12jDo8i2S_MY9lS76NFcHZCuKmZMgxH8QuTHY5PS3LRuDnoGFkRqSqDeXsT41o6ZCrqfbXhdhDisCIEVgt9FZ2-_WFY_oJfJ-RL_WE8rrrkn1TUehaPiYsxfeF5jZHKTlm8wHm-yI0fGdKKk Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Domain-Id: None Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Domain-Name: None Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Identity-Status: Confirmed Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Is-Admin-Project: True Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Domain-Id: default Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Domain-Name: Default Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Name: admin Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Role: member,reader,admin Aug 29 23:53:21.391915 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Roles: member,reader,admin Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}] Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant: admin Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant-Name: admin Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User: admin Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Domain-Id: default Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Domain-Name: Default Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Id: 1c8e233e14fe4b94bbd97e9de03f0d21 Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Name: admin Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: method: > Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: exception: Flavor 84 could not be found. Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: action_args: {'id': '84'} Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:21.393402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:21.394342 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:21.395551 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1793ff21-684a-48fd-ade0-e9a7b923413e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:21.396532 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1793ff21-684a-48fd-ade0-e9a7b923413e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012605 Aug 29 23:53:21.396532 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 23:53:22.366175 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-c3464b1b-84ed-4023-86bb-934b0a234f29 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.367215 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-c3464b1b-84ed-4023-86bb-934b0a234f29 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 29 23:53:22.367620 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:22.882931 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6b875f6b-2d8a-47c7-8212-1b77d9908594 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.888700 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.wsgi [None req-6b875f6b-2d8a-47c7-8212-1b77d9908594 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6b875f6b-2d8a-47c7-8212-1b77d9908594 admin admin] Request method failure captured: Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Accept: application/json Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Accept-Encoding: gzip, deflate Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Connection: keep-alive Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Content-Length: 0 Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Host: 10.222.0.60 Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Openstack-Api-Version: compute 2.90 Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Openstack-System-Scope: None Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: User-Agent: python-novaclient Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Auth-Token: gAAAAABjDVFyKvhzcyQPqxBIKldAPibWfIg29bx-P5ygLj8WipeEel7Q-_9xxm8rx8gsEnnbK-EKV9dhzhGSsCSkDGmNAHGuwiltebAiklBudJdVE-G2F5oqXaxueD9Hu18PNuukTxUsXf7x8MHj7D7N0F6VUbczcufqyKkhBBBWM4bFGQBN2b0 Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Domain-Id: None Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Domain-Name: None Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Identity-Status: Confirmed Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Is-Admin-Project: True Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Domain-Id: default Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Domain-Name: Default Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Project-Name: admin Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Role: member,reader,admin Aug 29 23:53:22.890372 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Roles: member,reader,admin Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}] Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant: admin Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-Tenant-Name: admin Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User: admin Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Domain-Id: default Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Domain-Name: Default Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Id: 1c8e233e14fe4b94bbd97e9de03f0d21 Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: X-User-Name: admin Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: method: > Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: exception: Flavor 451 could not be found. Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: action_args: {'id': '451'} Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:22.891949 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:22.892944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.894214 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-6b875f6b-2d8a-47c7-8212-1b77d9908594 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:22.896023 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-6b875f6b-2d8a-47c7-8212-1b77d9908594 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386546 Aug 29 23:53:22.896023 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:22.901805 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-bcad4628-d858-46af-9a0a-17c278f2bf80 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.917678 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-bcad4628-d858-46af-9a0a-17c278f2bf80 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019496 Aug 29 23:53:22.918213 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:22.927788 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.943111 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018976 Aug 29 23:53:22.943645 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:22.952666 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-a8e4f1a4-4c9f-44f3-9edf-2807662468bd admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.958518 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.wsgi [None req-a8e4f1a4-4c9f-44f3-9edf-2807662468bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-a8e4f1a4-4c9f-44f3-9edf-2807662468bd admin admin] Request method failure captured: Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Accept: application/json Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Accept-Encoding: gzip, deflate Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Connection: keep-alive Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Content-Length: 0 Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Host: 10.222.0.60 Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Openstack-Api-Version: compute 2.90 Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Openstack-System-Scope: None Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: User-Agent: python-novaclient Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Auth-Token: gAAAAABjDVFyKvhzcyQPqxBIKldAPibWfIg29bx-P5ygLj8WipeEel7Q-_9xxm8rx8gsEnnbK-EKV9dhzhGSsCSkDGmNAHGuwiltebAiklBudJdVE-G2F5oqXaxueD9Hu18PNuukTxUsXf7x8MHj7D7N0F6VUbczcufqyKkhBBBWM4bFGQBN2b0 Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Domain-Id: None Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Domain-Name: None Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Identity-Status: Confirmed Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Is-Admin-Project: True Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Domain-Id: default Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Domain-Name: Default Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Project-Name: admin Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Role: member,reader,admin Aug 29 23:53:22.960065 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Roles: member,reader,admin Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40c2e586897f4f62bf707d44b36b2b76"}]}] Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant: admin Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant-Id: 40c2e586897f4f62bf707d44b36b2b76 Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-Tenant-Name: admin Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User: admin Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Domain-Id: default Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Domain-Name: Default Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Id: 1c8e233e14fe4b94bbd97e9de03f0d21 Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: X-User-Name: admin Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: method: > Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: exception: Flavor 451 could not be found. Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: action_args: {'id': '451'} Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:22.961470 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:22.962387 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: ERROR nova.api.openstack.wsgi Aug 29 23:53:22.963505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-a8e4f1a4-4c9f-44f3-9edf-2807662468bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:22.964729 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-a8e4f1a4-4c9f-44f3-9edf-2807662468bd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012283 Aug 29 23:53:22.964729 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:23.936421 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:23.937647 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Aug 29 23:53:23.938045 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:24.465199 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-ebe7bd78-00fe-496d-8e01-80151a552cd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:24.532179 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-ebe7bd78-00fe-496d-8e01-80151a552cd8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.453133 Aug 29 23:53:24.532650 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Aug 29 23:53:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:53:25.513816 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:25.514850 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 29 23:53:25.515247 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:26.035178 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-0f7dc7f4-093f-4bcf-8e99-c215946c7594 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:26.120019 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-0f7dc7f4-093f-4bcf-8e99-c215946c7594 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.465961 Aug 29 23:53:26.120575 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Aug 29 23:53:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:53:27.099639 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:27.101022 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002311 Aug 29 23:53:27.101650 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:27.638782 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-73a96906-ba66-4b4a-9a12-0e1a5e1ee25f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:27.731533 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-73a96906-ba66-4b4a-9a12-0e1a5e1ee25f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.481138 Aug 29 23:53:27.732090 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Aug 29 23:53:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:53:28.815815 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:28.816844 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 29 23:53:28.817242 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:29.334555 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-0862815c-374a-425d-a7ce-39f8af388b1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:29.409690 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-0862815c-374a-425d-a7ce-39f8af388b1e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.455801 Aug 29 23:53:29.410176 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Aug 29 23:53:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:53:30.383532 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:30.384545 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 29 23:53:30.384944 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:30.906819 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-0c1f22c5-4680-4d45-ae21-c18abee1fbfa admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:30.927236 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-0c1f22c5-4680-4d45-ae21-c18abee1fbfa admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404449 Aug 29 23:53:30.927782 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Mon Aug 29 23:53:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:24.622566 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.623490 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-8e881a5e-8e7d-49ea-acc1-50075c0629de admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 29 23:54:24.623892 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:24.634601 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:25.017180 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-a33baec1-3663-4772-a75d-f93197f9b6b8 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.038627 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-a33baec1-3663-4772-a75d-f93197f9b6b8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408390 Aug 29 23:54:25.039163 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:25.059425 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG dbcounter [-] [112333] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:25.063161 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-50dfb7b9-2920-4cf2-af7a-b15d44a0ade0 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.070862 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-50dfb7b9-2920-4cf2-af7a-b15d44a0ade0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012859 Aug 29 23:54:25.071998 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:25.083193 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-21d826b9-545a-4129-bfae-29672c241b71 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.090670 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-21d826b9-545a-4129-bfae-29672c241b71 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011492 Aug 29 23:54:25.091174 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:25.103281 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.111029 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011607 Aug 29 23:54:25.111542 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:25.122894 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-8c32c94b-df36-41e3-a4ae-e29b45e300bc admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.130440 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-8c32c94b-df36-41e3-a4ae-e29b45e300bc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011109 Aug 29 23:54:25.130983 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:32.162358 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:32.163402 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 29 23:57:32.163793 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:32.306412 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_api:SELECT=6 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:32.462872 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:32.466271 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:32.466777 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:32.467209 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:32.467915 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:32.468932 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:32.469341 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:32.504674 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-72746486-1034-4103-94e4-094fe273ccef admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199634 Aug 29 23:57:32.505235 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Aug 29 23:57:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:57:33.351162 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:33.352255 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 29 23:57:33.352676 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:33.551281 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:33.554688 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:33.555163 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:33.555584 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:33.556291 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:33.556731 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:33.557145 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:33.576733 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-f216410c-eb4b-43d3-823b-50eaf1e5fe52 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084170 Aug 29 23:57:33.577221 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Aug 29 23:57:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:57:44.805395 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:44.806400 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 29 23:57:44.806838 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:57:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:44.951389 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_cell0:SELECT=4 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:44.952114 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_cell1:SELECT=4 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:44.952716 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG dbcounter [-] [112334] Writing DB stats nova_api:SELECT=8 {{(pid=112334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:45.007943 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:45.011554 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:45.012021 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:45.012440 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:45.013496 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:45.013938 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:45.014348 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:45.041432 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-7664483f-34b5-4156-b501-a73aa7d246c8 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094525 Aug 29 23:57:45.042227 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Aug 29 23:57:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:45.869006 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: DEBUG nova.api.openstack.wsgi [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] Calling method '>' {{(pid=112333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:45.870041 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: INFO nova.api.openstack.requestlog [None req-1f5ed9a0-e6c6-42f3-9bd8-c60680a825a9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 29 23:57:45.870439 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: [pid: 112333|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Aug 29 23:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:46.060591 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG nova.api.openstack.wsgi [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] Calling method '>' {{(pid=112334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:46.064505 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:46.064974 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:46.065422 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:46.066123 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:46.066635 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:46.067006 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: DEBUG oslo_concurrency.lockutils [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:46.089652 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: INFO nova.api.openstack.requestlog [None req-e40cded2-03ad-4d2a-9d2c-414508c0b87c admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079594 Aug 29 23:57:46.090139 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: [pid: 112334|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Aug 29 23:57:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:42.456894 dv-cinder-854273-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 23:58:42.457787 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: Mon Aug 29 23:58:42 2022 - graceful shutdown triggered... Aug 29 23:58:42.458388 dv-cinder-854273-4-iscsi devstack@n-api.service[112334]: Gracefully killing worker 2 (pid: 112334)... Aug 29 23:58:42.459265 dv-cinder-854273-4-iscsi devstack@n-api.service[112333]: Gracefully killing worker 1 (pid: 112333)... Aug 29 23:58:43.458365 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: worker 1 buried after 1 seconds Aug 29 23:58:43.458945 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: worker 2 buried after 1 seconds Aug 29 23:58:43.458945 dv-cinder-854273-4-iscsi devstack@n-api.service[112332]: goodbye to uWSGI. Aug 29 23:58:43.459951 dv-cinder-854273-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 23:58:43.460497 dv-cinder-854273-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 23:58:43.463366 dv-cinder-854273-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 23:58:43.474254 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:58:43 2022] *** Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: nodename: dv-cinder-854273-4-iscsi Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: machine: x86_64 Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: clock source: unix Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: pcre jit disabled Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: detected number of CPU cores: 4 Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: current working directory: / Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:58:43.476265 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: your processes number limit is 47680 Aug 29 23:58:43.477181 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: your memory page size is 4096 bytes Aug 29 23:58:43.477181 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: detected max file descriptor number: 2048 Aug 29 23:58:43.477181 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: lock engine: pthread robust mutexes Aug 29 23:58:43.477181 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: thunder lock: enabled Aug 29 23:58:43.477181 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 23:58:43.477181 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:58:43.517738 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: Python main interpreter initialized at 0x55b365df49c0 Aug 29 23:58:43.517738 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: python threads support enabled Aug 29 23:58:43.517738 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: your server socket listen backlog is limited to 100 connections Aug 29 23:58:43.517738 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:58:43.518109 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:58:43.518182 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: *** Operational MODE: preforking *** Aug 29 23:58:43.518460 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:58:43.518460 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: spawned uWSGI master process (pid: 127757) Aug 29 23:58:43.526774 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: spawned uWSGI worker 1 (pid: 127768, cores: 1) Aug 29 23:58:43.526774 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: spawned uWSGI worker 2 (pid: 127769, cores: 1) Aug 29 23:58:43.526774 dv-cinder-854273-4-iscsi devstack@n-api.service[127757]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:58:43.518677 dv-cinder-854273-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 23:58:44.183984 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:58:44.185334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:58:45.353313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:58:45.353313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: from cryptography.utils import int_from_bytes Aug 29 23:58:45.354021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:58:45.354021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: from cryptography.utils import int_from_bytes Aug 29 23:58:45.355029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:58:45.355029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: from cryptography.utils import int_from_bytes Aug 29 23:58:45.355488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:58:45.355488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: from cryptography.utils import int_from_bytes Aug 29 23:58:47.757249 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:58:47.757896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:58:47.758035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:58:47.758401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:58:47.758686 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:58:47.759066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.759389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.759708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.760024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.760493 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.760809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.761131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.761454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.761791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.762054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.762370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.762722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-4-iscsi {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.763048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.763355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.763664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.763983 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.764289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.764615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.764919 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.765415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.766406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.767012 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.767332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.767451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:58:47.767811 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.767892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:58:47.767971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.768210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:58:47.768437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.768547 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.768653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:58:47.768864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.769034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:58:47.769179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.769480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.769635 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.769878 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-4-iscsi {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.769980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.770196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.770455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.770582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.770847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.771007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.771259 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.771568 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.771715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.771867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.772029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.772181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.772489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.772647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.772787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.773099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.773250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.773419 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.773664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.773774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.774044 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.774146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.774352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.774497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.774692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.774798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-4-iscsi {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.774999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.775154 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.775321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.775492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.775611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.776535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.776708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.776708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.777008 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.777152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.777311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.777455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.777613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.777766 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.777914 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778057 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778057 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778536 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778631 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778771 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.778986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779699 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779849 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.779958 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.780154 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.780258 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.780475 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.780643 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.780780 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.780887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.781098 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.781199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-4-iscsi {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.781470 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.782113 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.782301 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.782396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.782630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.782739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.782950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.783141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.783363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.783457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.783615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.783741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.783921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.784059 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.784263 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.784366 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.784585 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.784714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.784900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.785015 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.785205 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.785309 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.785525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.785624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.785831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.785938 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.786136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.786237 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.786440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.786602 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.786750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.786839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787170 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787368 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787623 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787901 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.787994 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.788202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.788302 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.788520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.788639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.788825 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.788935 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.789131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.789227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.789381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.789476 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.789618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.789723 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.789940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.790047 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.790255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.790351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.790581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.790696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.790884 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.791019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.791182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.791286 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.791485 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.791587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.791786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.791879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.792086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.792204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.792384 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.792529 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.792677 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.792776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.792992 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.793087 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.793303 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.793398 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.793602 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.793695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.793904 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.793999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.794210 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.794312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.794552 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.794649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.794857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.794979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.795161 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.795287 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.795481 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.795604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.795786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.795892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.796089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.796181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.796404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.796498 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.796709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.796817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.797034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.797128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.797336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.797438 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.797634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.797734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.797938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.798038 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.798253 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.798354 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.798576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.798672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.798824 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.798915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.799119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.799224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.799415 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.799510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.799735 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.799834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.800031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.800138 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.800330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.800423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.800627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.800718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.800919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.801022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.801219 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.801312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.801519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.801613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.801818 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.801921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.802116 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.802228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.802415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.802557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.802757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.802948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.803092 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.803182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.803398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.803490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.803697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.803798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.804013 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.804113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.804332 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.804425 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.804633 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.804728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.805138 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.805235 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.805319 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.805419 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.805514 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.805648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.805807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.805911 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.806107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.806207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.806406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.806532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.806748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.806900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.807048 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.807218 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.807352 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.807464 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.807644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.807749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.807942 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.808043 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.808240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.808333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.808552 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.808730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.808863 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.808952 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.809131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.809232 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.809442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.809544 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.809744 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.809845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.810040 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.810141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.810334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.810438 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.810660 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.810786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.810957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.811098 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.811252 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.811423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.811548 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.811744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.811836 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.812298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.812433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.812534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.812620 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.812759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.812879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.813000 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.813143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.813302 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.813409 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.813642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.813737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.813933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.814026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:58:47.814246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.814339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.814592 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.814679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.814905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.815001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.815217 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.815299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.815527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.815616 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.815836 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.815929 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.816145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.816234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.816480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.816561 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.816787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.816870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.817108 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.817187 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.817413 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.817563 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.817709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.817940 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.818074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.818209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.818362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.818518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.818662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.818769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.818941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.819033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.819251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.819414 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.819551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.819650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.819844 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.819990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.820149 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.820263 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.820451 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.820554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.820771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.820871 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.821087 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.821255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.821392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.821547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.821695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.821817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.822011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.822185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.822322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.822424 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.822660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.822771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.822971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.823076 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.823277 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.823374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827343 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.827931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.828026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.828633 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.828773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.828773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.828987 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.828987 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.829205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.829365 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.829545 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.829545 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.829779 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.829779 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.829779 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830123 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830320 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830416 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830567 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.830945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831265 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831365 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831451 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.831958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832295 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832472 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832564 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832702 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832796 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.832979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833235 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833425 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833592 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833674 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833855 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.833941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834681 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.834995 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.835192 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.835286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.835495 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.835588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.835823 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.835915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.836136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.836228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.836440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.836532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.836742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.836835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.837059 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.837152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.837360 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.837452 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.837661 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.837755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.837969 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.838061 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.838274 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.838368 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.838610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.838709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.838926 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.839081 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.839211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.839340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.839525 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.839619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.839832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.839924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.840135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.840237 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.840448 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.840540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.840772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.840871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.841069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.841170 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.841389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.841489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.841694 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.841795 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.842002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.842115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.842301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.842393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.842630 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.842725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.842930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.843032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.843227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.843327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.843525 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.843626 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.844385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.844489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.844754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.844855 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.845059 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.845153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.845357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.845459 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.845658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.845753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.845958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.846050 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.846268 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.846367 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.846595 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.846692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.846898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.847043 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.847196 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.847296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.847495 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.847587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.847814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.847920 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.848120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.848220 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.848433 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.848537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.848761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.848868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.849126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.849247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.849386 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.849525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.849679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.849787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.849988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.850090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.850296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.850388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.850624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.850718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.850932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.851034 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.851236 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.851329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.851542 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.851637 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.851844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.851944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.852157 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.852258 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.852461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.852556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.852772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.852902 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.853075 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.853175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.853388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.853481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.853685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.853778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.853986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.854086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.854289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.854383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.854622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.854736 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.854946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.855053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.855256 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.855357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.855557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.855656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.855864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.855966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.856168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.856261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.856472 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.856570 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.856772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.856873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.857075 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.857176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.857377 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.857467 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.857676 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.857778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.857977 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.858118 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.858279 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.858371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.858619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.858922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.859019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.859122 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.859563 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.859708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.859833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.859947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860059 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860170 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860280 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860528 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.860879 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.861042 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.861166 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.861358 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.861482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.861662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.861791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.861966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.862101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.862270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.862401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.862594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.862729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.862897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.863034 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.863203 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.863333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.863515 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.863636 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.863819 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.863948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.864126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.864271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.864586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.864901 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.865219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.865394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.865730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.865851 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.866054 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.866155 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.866368 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.866463 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.866704 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.866810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.867024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.867129 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.867355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.867449 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.867672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.867775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.868000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.868094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.868327 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.868420 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.868635 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.868735 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.868939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.869031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.869243 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.869355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.869613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.869741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.869831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.869923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.870140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.870235 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.870439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.870572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.870768 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.870864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.871081 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.871175 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.871386 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.871494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.871690 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.871784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.871993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.872094 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.872295 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.872398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.872606 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.872705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.872913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.873080 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.873220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.873318 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.873509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.873612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.873833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.873927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.874140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.874286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.874443 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.874609 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.874766 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.874862 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.875092 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.875197 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.875412 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.875505 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.875729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.875836 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.876032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.876125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.876338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.876443 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.876643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.876751 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.876942 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.877036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.877247 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.877349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.877558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.877660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.877887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.878125 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.878227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.878456 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.878598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.878789 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.878890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.879094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.879187 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.879394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.879496 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.879707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.879837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.880015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.880143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.880323 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.880436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.880629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.880733 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.880931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.881106 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.881232 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.881332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.881533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.881636 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.881830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.881931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.882134 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.882237 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.882434 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.882551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.882758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.882861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.883067 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.883161 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.883375 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.883468 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.883677 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.883770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.883971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.884070 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.884267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.884383 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.884794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.884905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885088 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885171 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.885823 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.886041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.886148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.886342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.886434 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.886676 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.886773 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.886975 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.887088 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.887272 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.887367 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.887573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.887666 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.887880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.888043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.888177 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.888277 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.888481 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.888626 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.888791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.888944 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.889113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.889249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.889472 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.889573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.889773 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.889868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.890022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.890116 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.890324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.890419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.891243 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.891415 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.891877 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.892060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.892213 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.892377 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.892533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.892681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.892827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.892972 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.893125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.893232 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.893232 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.893539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.893838 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.894141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.894440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.894774 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.895078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.895285 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.895407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.895631 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.895762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.895952 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.896049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.896256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.896359 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.896554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.896656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.896859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.896962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.897156 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.897259 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.897464 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.897567 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.897762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.897908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.898061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.898234 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.898363 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.898695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.898814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.899002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.899113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.899299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.899443 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.899617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.899763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.900021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.900132 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.900228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.900390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.900495 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.900701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.900845 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.901056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.901194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.901341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902110 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.902976 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.903294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.903624 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.903953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.904355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.904505 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.904649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.904842 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.904991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.905119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.905250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.905340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.905495 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.905630 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.905808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.906169 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.906311 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.906927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.907089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.907415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.907734 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.908051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.908225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.908393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.908517 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.908707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.908815 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.909033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.909139 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.909349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.909451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.909660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.909792 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.910003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.910257 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.910367 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.910494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.910625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.910729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.910939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.911034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.911247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.911352 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.911562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.911655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.911870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.911963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.912246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.912353 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.912559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.912655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.912870 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.912964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.913182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.913289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.913486 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.913579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.913801 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.913895 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.914110 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.914205 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.914421 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.914535 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.914750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.914859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.915053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.915196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.915372 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.915484 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.915678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.915772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.915983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.916086 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.916301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.916396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.916620 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.916714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.916942 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.917035 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.917242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.917342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.917548 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.917650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.917854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.917962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.918159 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.918252 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.918480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.918594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.918802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.918894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.919109 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.919201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.919419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.919811 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.919905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.920123 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.920257 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.920436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.920619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.920740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.920842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.921054 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.921149 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.921362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.921456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.921666 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.921768 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.922025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.922120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.922335 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.922429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.922664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.922760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.922973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.923068 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.923295 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.923432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.923587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.923708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.923888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.923992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.924267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.924361 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.924576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.924678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.924902 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.925014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.925232 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.925335 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.925494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.925576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.925803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.925908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.926116 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.926245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.926428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.926599 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.926761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.926904 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.927173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.927286 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.927485 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.927596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.927794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.927903 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.928099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.928206 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.928401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.928509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.928703 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.928800 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.929008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.929112 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.929327 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.929434 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.929624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.929740 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.929998 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.930109 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.930210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.930299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.930552 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.930672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.930860 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.930944 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.931165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.931267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.931488 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.931582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.931794 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.931888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.932120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.932223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.932438 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.932562 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.932762 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.932855 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.933090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.933198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.933397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.933501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.933722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.933817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.934032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.934127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.934338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.934441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.934667 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.934782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.934974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.935068 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.935480 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.935643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.935748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.935836 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.935935 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.936037 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.936266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.936360 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.936595 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.936705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.936907 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.937002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.937225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.937326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.937576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.937673 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.937897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.938140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.938264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.938597 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.938833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.938945 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.939202 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.939327 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.939513 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.939812 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.939917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.940117 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.940219 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.940424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.940607 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.940739 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.940866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.941059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.941171 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.941367 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.941479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.941670 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.941813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.941993 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.942320 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.942654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.942770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.942945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.943264 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.943375 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.943570 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.943717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.943873 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.944041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.944175 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.944357 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.944494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.944673 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.944796 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.944986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.945120 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.945388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.945484 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.945647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.945745 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.945982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.946073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.946297 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.946386 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.946650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.946754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.946964 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.947045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.947267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.947356 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.947568 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.947664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.947868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.947950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.948206 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.948307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.948503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.948596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.948818 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.948940 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.949155 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.949257 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.949451 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.949553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.949755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.949844 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.950077 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.950219 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.950398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.950680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.950924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.951076 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.951182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.951330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.951440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.951639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.951733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.951939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.952033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.952246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.952349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.952548 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.952650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.952849 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.952942 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.953682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.953793 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.953989 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.954084 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.954290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.954434 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.954616 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.954714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.954912 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.955039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.955225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.955332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.955526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.955646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.955847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.955990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.956182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.956326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.956442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.956613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.956740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.956944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.957046 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.957306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.957410 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.957622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.957715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.957930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.958023 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.958241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.958463 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.958683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.958797 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.958911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.959018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.959198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.959301 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.959509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.959604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.959817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.959929 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.960130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.960745 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.960745 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.961079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.961079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.961462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.961621 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.961781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.961879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.961974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962160 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962805 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.962983 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.963119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.963326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.963474 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.963727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.963901 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.964025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.964139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.964331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.964482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.964701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.964825 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.964919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.965106 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.965227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.965422 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.965525 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.965742 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.965847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.966070 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.966164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.966378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.966509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.966710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.966817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.967019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.967115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.967330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.967426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.967637 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.967739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.967959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.968062 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.968272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.968373 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.968577 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.968674 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.969456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.969570 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.969766 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.969865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.970142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.970385 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.970522 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.970765 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.970863 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.971069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.971198 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.971384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.971492 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.971696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.971790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.972004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.972097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.972310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.972413 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.972619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.972729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.972928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.973057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.973238 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.973536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.973666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.973756 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.973843 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.973927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.974152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.974259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.974460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.974602 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.974793 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.974897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.975103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.975304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.975399 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.975615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.975715 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.975946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.976049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.976269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.976364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.976590 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.976739 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.976894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.977007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.977201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.977296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.977513 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.977607 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.977812 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.977921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.978113 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.978207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.978417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.978560 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.978779 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.978885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.979083 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.979187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.979402 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.979498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.979709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.979812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.980009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.980112 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.980320 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.980413 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.980623 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.980753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.980931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.981230 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.981368 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.981663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.981774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.981895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.981992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.982199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.982299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.982539 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.982651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.982853 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.982955 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.983155 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.983264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.983477 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.983580 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.983784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.983932 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.984082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.984178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.984416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.984524 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.984724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.984977 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.985072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.985311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.985411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.985616 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.985711 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.985921 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.986020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.986221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.986317 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.986546 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.986675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.986851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.986947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.987173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.987277 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.987476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.987570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.987776 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.987872 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.988076 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.988275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.988381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.988479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.988668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.988856 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.988974 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.989100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.989288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.989613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.989926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.990106 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.990271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.990427 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.990630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.990797 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.990964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.991133 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.991288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.991455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.991616 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.991770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.991932 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.992086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.992238 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.992398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.992560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.992713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.992880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.993033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.993242 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.993419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.993634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.993791 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.993966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.994120 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.994271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.994390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:47.994523 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.001509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.001693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.001806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.001906 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002201 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002387 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002659 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.002986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003224 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003452 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003610 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003841 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003911 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.003989 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004062 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004547 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004700 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004778 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.004989 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005215 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005368 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005673 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.005959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006040 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006363 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006553 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006720 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.006798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007841 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.007984 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008133 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008293 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008476 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008616 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.008973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009050 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009208 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009519 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009684 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009786 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.009940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010012 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010092 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010311 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.010941 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.011024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.011267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.011377 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.011604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.011691 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.012465 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.012570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.012644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.012733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.012807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013222 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013373 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013459 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013797 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.013979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014428 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.014984 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.015184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.015278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.015486 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.015634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.016341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.016440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.016900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.016995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.017206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.017312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.017532 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.017666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.017803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.017934 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.018173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.018322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.018450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.018600 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.018730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.018845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.019001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.019136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.019306 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.019428 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.019603 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.019735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.019900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.020033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.020197 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.020328 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.020534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.020664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.020908 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.021039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.021166 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.021289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.021464 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.021587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.022295 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.022446 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.022618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.022755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.022875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023391 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.023889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.024021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.024134 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.024245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.024364 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.024497 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.024623 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.024746 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:58:48.024851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.025109 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.025419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.025728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.026588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.026588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.026776 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.026969 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.027444 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.027778 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.028093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.028411 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.029889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.029889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.029889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.029889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.029889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.038556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.039798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.040697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.040697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:58:48.040697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:58:48.086705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO dbcounter [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Registered counter for database nova_api Aug 29 23:58:48.105711 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO dbcounter [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Registered counter for database nova_api Aug 29 23:58:48.107889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_db.sqlalchemy.engines [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.115128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writer thread running {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.127941 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_db.sqlalchemy.engines [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.134711 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writer thread running {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.173014 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.context [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03ce5c2-1a4b-434b-9dac-5218d9782043(cell1) {{(pid=127769) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:58:48.177238 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.177705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.179316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.180045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.180491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.182501 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.184648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO dbcounter [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Registered counter for database nova_cell0 Aug 29 23:58:48.189361 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO dbcounter [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Registered counter for database nova_cell1 Aug 29 23:58:48.192234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.context [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03ce5c2-1a4b-434b-9dac-5218d9782043(cell1) {{(pid=127768) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:58:48.196357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.196527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_db.sqlalchemy.engines [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.196846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.198441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.199214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.199662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.201318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writer thread running {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.201717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.205890 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO dbcounter [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Registered counter for database nova_cell0 Aug 29 23:58:48.208561 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO dbcounter [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Registered counter for database nova_cell1 Aug 29 23:58:48.218457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_db.sqlalchemy.engines [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.220496 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_db.sqlalchemy.engines [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.225678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writer thread running {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.231125 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writer thread running {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.339804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_db.sqlalchemy.engines [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.345939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writer thread running {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.355290 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO dbcounter [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Registered counter for database nova_cell0 Aug 29 23:58:48.363632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_db.sqlalchemy.engines [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.368154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writer thread running {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.381744 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO dbcounter [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Registered counter for database nova_cell0 Aug 29 23:58:48.388590 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_db.sqlalchemy.engines [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:58:48.393820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writer thread running {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:58:48.685962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: WARNING keystonemiddleware.auth_token [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:58:48.693892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: WARNING keystonemiddleware.auth_token [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:58:48.708714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: WARNING keystonemiddleware.auth_token [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:58:48.715978 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: WARNING keystonemiddleware.auth_token [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:58:49.040681 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: WARNING keystonemiddleware.auth_token [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:58:49.046710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: WARNING keystonemiddleware.auth_token [None req-7efe3231-e085-4250-a216-f692fec88c6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:58:49.052572 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b365df49c0 pid: 127769 (default app) Aug 29 23:58:49.061635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: WARNING keystonemiddleware.auth_token [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:58:49.069658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: WARNING keystonemiddleware.auth_token [None req-302ab011-f11c-4910-aafb-947ca7de218a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:58:49.075762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b365df49c0 pid: 127768 (default app) Aug 29 23:59:27.424500 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:27.425364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:27.426147 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:27.427005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:28.879708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f8d25526-46da-422a-941c-08bf5d6420ea tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Action: 'create', calling method: .version_select at 0x7f09c02c3e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1821488853", "metadata": {"Type": "work"}}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:31.412175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f8d25526-46da-422a-941c-08bf5d6420ea tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.000079 Aug 29 23:59:31.422727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Aug 29 23:59:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4012 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 23:59:31.899992 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1a8841a1-4759-4148-b161-89596db4dded tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Calling method '.version_select at 0x7f09c03279d0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:31.943974 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:31.945098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:31.945930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:31.950544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:32.828124 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1a8841a1-4759-4148-b161-89596db4dded tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87" status: 200 len: 354 microversion: 2.1 time: 1.402771 Aug 29 23:59:32.828820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:31 2022] GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87 => generated 354 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:32.853507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8d2d9688-9643-4d41-bbd1-d27276054cc4 tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Calling method '.version_select at 0x7f09c0149ca0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:32.945695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8d2d9688-9643-4d41-bbd1-d27276054cc4 tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87" status: 200 len: 354 microversion: 2.1 time: 0.094208 Aug 29 23:59:32.953999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:32 2022] GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:32.972150 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9ea7a272-497d-4bfa-b739-c6c7573a3d73 tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Calling method '.version_select at 0x7f09c0179e50>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:33.282211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9ea7a272-497d-4bfa-b739-c6c7573a3d73 tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87" status: 202 len: 0 microversion: 2.1 time: 0.328066 Aug 29 23:59:33.283064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Aug 29 23:59:32 2022] DELETE /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:59:33.291002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-32b75658-8fc9-4d8f-90f1-760ceeb305c6 tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Calling method '.version_select at 0x7f09c01603a0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:33.431171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-32b75658-8fc9-4d8f-90f1-760ceeb305c6 tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87" status: 200 len: 353 microversion: 2.1 time: 0.143950 Aug 29 23:59:33.431780 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:33 2022] GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:34.452902 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-479dabfa-fd70-4392-b374-0d02b03b1f6f tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Calling method '.version_select at 0x7f09c0179dc0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:34.800557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-479dabfa-fd70-4392-b374-0d02b03b1f6f tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] HTTP exception thrown: Volume 24b73822-9f65-4813-90dc-dc91bc1d6d87 could not be found. Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-479dabfa-fd70-4392-b374-0d02b03b1f6f tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Request method failure captured: Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87 HTTP/1.1 Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLfR3ibDIfXpmPzQZ2gBRrJVzVZ-op9GKWdHtMpyrM0vjMIPKkpo-0cZHPcfS_HMj-2L6u6s1VSk2nLZ5nvjufFEsQxMIxchwOFRUcgmEXASGV_uezzp8fkD4tlrnY3Ue8hvrQ2vSge7pK2HvbcxKUmIaDaZEdtuSWXJNivUkJ0kqs Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: aef5521994764ef98285a9a89160eab6 Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesGetTestJSON-991488970 Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 29 23:59:34.804743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aef5521994764ef98285a9a89160eab6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aef5521994764ef98285a9a89160eab6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aef5521994764ef98285a9a89160eab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aef5521994764ef98285a9a89160eab6"}]}] Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesGetTestJSON-991488970 Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: aef5521994764ef98285a9a89160eab6 Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesGetTestJSON-991488970 Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesGetTestJSON-991488970-project Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 6511c77ded4749dbbe7f5dbd2cc8c3fd Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesGetTestJSON-991488970-project Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Volume 24b73822-9f65-4813-90dc-dc91bc1d6d87 could not be found. Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '24b73822-9f65-4813-90dc-dc91bc1d6d87'} Aug 29 23:59:34.806064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24b73822-9f65-4813-90dc-dc91bc1d6d87 could not be found. (HTTP 404) (Request-ID: req-eee9a8e5-eb02-4fd9-8985-bce654497eb4) Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:34.807286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:34.808705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24b73822-9f65-4813-90dc-dc91bc1d6d87 could not be found. Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:59:34.809980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24b73822-9f65-4813-90dc-dc91bc1d6d87 could not be found. Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24b73822-9f65-4813-90dc-dc91bc1d6d87 could not be found. Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-479dabfa-fd70-4392-b374-0d02b03b1f6f tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] Returning 404 to user: Volume 24b73822-9f65-4813-90dc-dc91bc1d6d87 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:34.811334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-479dabfa-fd70-4392-b374-0d02b03b1f6f tempest-VolumesGetTestJSON-991488970 tempest-VolumesGetTestJSON-991488970-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87" status: 404 len: 109 microversion: 2.1 time: 0.363323 Aug 29 23:59:34.814778 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:34 2022] GET /compute/v2.1/os-volumes/24b73822-9f65-4813-90dc-dc91bc1d6d87 => generated 109 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:39.364669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1181110431", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:39.586847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] validate_networks() for [('5b7a3909-5ba9-4db0-b334-bd9a41efe3bc', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:59:42.731376 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-db7b9b8a-f40b-4392-8705-0c1ff75800b9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'create', calling method: .version_select at 0x7f09c099c820>, body: {"keypair": {"name": "tempest-keypair-109459989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfKTXIsThRzy471vqsdG+impN7nDNaJTwNZxdDjPtUNIeDaibGl1I4IT+ByqnVHANCUTR+46W6LPFYyChs2CQZN9cmTjXruxedHZhwhRp2BgmVZJygaKOjxZTGaod/FbQ=="}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:42.950842 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-db7b9b8a-f40b-4392-8705-0c1ff75800b9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:42.995001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-db7b9b8a-f40b-4392-8705-0c1ff75800b9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for user 7812e8e2bc794f1cbd19c1c176bb93af and project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:43.139308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:59:43.140025 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:59:43.140505 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:59:43.140906 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:59:43.141321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:59:43.188359 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:43.188860 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:43.189297 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:43.192405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:43.192922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:43.194792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:43.289915 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-db7b9b8a-f40b-4392-8705-0c1ff75800b9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.190810 Aug 29 23:59:43.299745 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:43.299939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 4/7] 10.222.0.60 () {62 vars in 1200 bytes} [Mon Aug 29 23:59:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 23:59:43.306025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-765782d3-26f8-405c-9a2b-3dd5a6978819 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09c003e280>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:43.313208 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for user e0a5a4228c5d41c7898aa768dfe359ca and project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:43.364308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:59:43.377739 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:59:43.440849 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-765782d3-26f8-405c-9a2b-3dd5a6978819 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b84c5e7a-753f-49fd-b5f9-bd998872f720" status: 200 len: 351 microversion: 2.1 time: 0.139893 Aug 29 23:59:43.442944 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:43 2022] GET /compute/v2.1/os-volumes/b84c5e7a-753f-49fd-b5f9-bd998872f720 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:43.708660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3cdbd4d8-1fc4-4319-b2a2-8704724f520e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.717818 Aug 29 23:59:43.710820 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 4/9] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Aug 29 23:59:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 4720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:59:43.728054 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6358406d-d91e-4aee-a8bc-02eea9bc04c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:43.729031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6358406d-d91e-4aee-a8bc-02eea9bc04c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:44.391415 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6358406d-d91e-4aee-a8bc-02eea9bc04c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:44.437682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6358406d-d91e-4aee-a8bc-02eea9bc04c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1222 microversion: 2.1 time: 0.708416 Aug 29 23:59:44.440907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:43 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1222 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:44.849566 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1104973552", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:45.008867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] validate_networks() for [('5b7a3909-5ba9-4db0-b334-bd9a41efe3bc', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:59:45.894357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f05f9e84-4d2c-4655-9c60-d378896000b9 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09c008ab80>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:46.039254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f05f9e84-4d2c-4655-9c60-d378896000b9 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/daed3a77-ab6c-41bb-a1a2-a8c9ee3b3d81" status: 200 len: 351 microversion: 2.1 time: 0.150843 Aug 29 23:59:46.040590 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 7/11] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:45 2022] GET /compute/v2.1/os-volumes/daed3a77-ab6c-41bb-a1a2-a8c9ee3b3d81 => generated 351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:46.926317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1192360804", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "networks": [{"uuid": "7d28c1e1-bea9-4850-be19-cfef4cae4494"}]}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:47.191916 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] validate_networks() for [('7d28c1e1-bea9-4850-be19-cfef4cae4494', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:59:47.229160 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:59:47.231424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:59:47.231424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:59:47.231424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:59:47.231424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:59:47.276647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:47.277156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:47.277570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:47.288371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:47.288877 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:47.289321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:47.372960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:47.402260 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for user e0a5a4228c5d41c7898aa768dfe359ca and project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:47.475422 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:59:47.486961 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:59:47.668825 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d29c1c69-0f2c-473b-8d7d-e6483cc2cf61 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.820061 Aug 29 23:59:47.669803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 5/12] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Aug 29 23:59:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:59:47.791263 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b65c4399-32aa-4326-aa64-6f183046e457 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'create', calling method: .version_select at 0x7f09bf7f23a0>, body: {"keypair": {"name": "tempest-keypair-1833504788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrA70XXsvTp7XIN/Z53x+5z+1FGE62TJa9SUlXU+tjBxK93HO2XrxGQkDoFVEmJpm1P/qsWh6cztLfTCApeJlxlrvNaSJhKUXTg761YKugLbl7MgibQvTR7FYEPF66Hzg=="}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:47.843066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-b65c4399-32aa-4326-aa64-6f183046e457 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:47.849709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-b65c4399-32aa-4326-aa64-6f183046e457 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for user 3f27121b3ab54d5194dedcbe4b112727 and project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:48.037211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b65c4399-32aa-4326-aa64-6f183046e457 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.363746 Aug 29 23:59:48.046905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 6/13] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Aug 29 23:59:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:48.052165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b9ab3422-393f-497c-9bbc-c17e3c283de9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:48.052794 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b9ab3422-393f-497c-9bbc-c17e3c283de9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:48.250248 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b9ab3422-393f-497c-9bbc-c17e3c283de9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:48.308682 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b9ab3422-393f-497c-9bbc-c17e3c283de9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1222 microversion: 2.1 time: 0.267540 Aug 29 23:59:48.321032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 7/14] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:48 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:48.682335 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e6897bdc-ae4c-456a-b8b7-f7f8b6e2a004 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bf81dc10>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:48.876203 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e6897bdc-ae4c-456a-b8b7-f7f8b6e2a004 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/24f8be5c-ba3d-42f6-a51d-970fb334eb65" status: 200 len: 351 microversion: 2.1 time: 0.210626 Aug 29 23:59:48.884578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 8/15] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:48 2022] GET /compute/v2.1/os-volumes/24f8be5c-ba3d-42f6-a51d-970fb334eb65 => generated 351 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:48.897548 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-90d335d8-d878-4ba4-a92e-ee2058dba433 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bf7b6f70>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:49.258440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-90d335d8-d878-4ba4-a92e-ee2058dba433 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.372285 Aug 29 23:59:49.262688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 9/16] 10.222.0.60 () {58 vars in 1134 bytes} [Mon Aug 29 23:59:48 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:49.277992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1b920ddb-8695-415f-88cd-0cfbcaf420d4 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bf7b6d30>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:49.575652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1b920ddb-8695-415f-88cd-0cfbcaf420d4 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.305240 Aug 29 23:59:49.576703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 10/17] 10.222.0.60 () {58 vars in 1149 bytes} [Mon Aug 29 23:59:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:49.581943 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aa4e7cde-7210-4b81-b88a-37ab759b6e6b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:49.582611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aa4e7cde-7210-4b81-b88a-37ab759b6e6b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:49.809597 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aa4e7cde-7210-4b81-b88a-37ab759b6e6b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:49.837379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aa4e7cde-7210-4b81-b88a-37ab759b6e6b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1222 microversion: 2.1 time: 0.259038 Aug 29 23:59:49.840593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 11/18] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:49 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1222 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:49.853436 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-551ade59-5169-47b5-93dc-e00bb1124032 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bf7bb160>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:49.897621 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:59:49.898130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:59:49.898518 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:59:49.898927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:59:49.899341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:59:49.917598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:49.918172 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:49.918645 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:49.923771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:49.924306 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:49.924743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:49.997077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Getting quotas for project 4c56e7fb47fb444e993e217411fb4b50. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:50.018248 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Getting quotas for user 2adc8b5b53b9404d88d88e511e607d1b and project 4c56e7fb47fb444e993e217411fb4b50. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:50.049803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:59:50.068739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:59:50.082278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-551ade59-5169-47b5-93dc-e00bb1124032 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.238943 Aug 29 23:59:50.082995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 12/19] 10.222.0.60 () {58 vars in 1134 bytes} [Mon Aug 29 23:59:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:50.097869 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e66975a7-b302-454e-a8f2-3fcb420adbc6 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bf7b6af0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:50.249758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e66975a7-b302-454e-a8f2-3fcb420adbc6 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.156376 Aug 29 23:59:50.250415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 13/20] 10.222.0.60 () {58 vars in 1167 bytes} [Mon Aug 29 23:59:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:50.264814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-212b5dbc-ac08-4f96-a044-9b5b0b73ee4b tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09c0ad4160>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:50.298006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-475157c8-47b2-4206-b065-ddfb73b28082 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.153411 Aug 29 23:59:50.308677 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 8/21] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Aug 29 23:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 4164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:59:50.317240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-202b6d57-2767-4c17-942c-2784164525df tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:50.317872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-202b6d57-2767-4c17-942c-2784164525df tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:50.456375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-202b6d57-2767-4c17-942c-2784164525df tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:50.467863 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-202b6d57-2767-4c17-942c-2784164525df tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1215 microversion: 2.1 time: 0.154174 Aug 29 23:59:50.468462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 9/22] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:50 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:50.527427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-212b5dbc-ac08-4f96-a044-9b5b0b73ee4b tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.267247 Aug 29 23:59:50.528176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 14/23] 10.222.0.60 () {58 vars in 1170 bytes} [Mon Aug 29 23:59:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:50.542484 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8d6822b9-c5b7-433a-b6e1-afc9aed0055a tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bff9e9d0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:50.675101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1826566236", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8558be8c-cad1-43e0-982e-6ed2ea36eb48"}], "security_groups": [{"name": "tempest-securitygroup--1054209676"}], "key_name": "tempest-keypair-109459989", "user_data": "}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:50.797552 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8d6822b9-c5b7-433a-b6e1-afc9aed0055a tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.258298 Aug 29 23:59:50.797706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 10/24] 10.222.0.60 () {58 vars in 1155 bytes} [Mon Aug 29 23:59:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:50.811356 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3998ca7f-ca8c-401f-bdec-8422cce484f5 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bff9ee50>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:50.881017 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] validate_networks() for [('8558be8c-cad1-43e0-982e-6ed2ea36eb48', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:59:50.913725 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3998ca7f-ca8c-401f-bdec-8422cce484f5 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.106800 Aug 29 23:59:50.922581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 11/25] 10.222.0.60 () {58 vars in 1188 bytes} [Mon Aug 29 23:59:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:50.926009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:50.926612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:50.942117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:50.942642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:50.943086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:50.943781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:50.944430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:50.945012 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:51.178801 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:51.207557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6c06c311-07ac-4da8-bcbb-2853437ab148 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1226 microversion: 2.1 time: 0.291609 Aug 29 23:59:51.209418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 12/26] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:50 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1226 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:51.221388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fdc331f8-1c23-4979-950f-abb42bb96c71 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] Calling method '.version_select at 0x7f09bf711ca0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:51.472852 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fdc331f8-1c23-4979-950f-abb42bb96c71 tempest-VolumesTestJSON-432702187 tempest-VolumesTestJSON-432702187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.262196 Aug 29 23:59:51.474030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 13/27] 10.222.0.60 () {58 vars in 1155 bytes} [Mon Aug 29 23:59:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:51.497005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6694fa7b-29f4-486e-ad0d-cdd1e5f6d231 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:51.498001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6694fa7b-29f4-486e-ad0d-cdd1e5f6d231 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:51.628821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6694fa7b-29f4-486e-ad0d-cdd1e5f6d231 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:51.639911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6694fa7b-29f4-486e-ad0d-cdd1e5f6d231 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1215 microversion: 2.1 time: 0.147218 Aug 29 23:59:51.641956 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 14/28] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:51 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:51.780767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:59:51.781755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:59:51.782398 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:59:51.782989 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:59:51.783784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:59:51.805318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:51.819254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:51.819690 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:51.820524 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:51.820993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:51.821512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:51.865432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:51.871400 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for user 7812e8e2bc794f1cbd19c1c176bb93af and project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:51.921503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:59:51.927845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:59:52.066578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-cf5681be-11f8-47e2-ba2f-51c212a9125b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.396063 Aug 29 23:59:52.067590 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 15/29] 10.222.0.60 () {62 vars in 1188 bytes} [Mon Aug 29 23:59:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 23:59:52.079203 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-73db6809-86b1-4b71-a2c3-0351163a4f67 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:52.079874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-73db6809-86b1-4b71-a2c3-0351163a4f67 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:52.195584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-73db6809-86b1-4b71-a2c3-0351163a4f67 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:52.212350 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-73db6809-86b1-4b71-a2c3-0351163a4f67 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:52.214372 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-73db6809-86b1-4b71-a2c3-0351163a4f67 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:52.216576 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-73db6809-86b1-4b71-a2c3-0351163a4f67 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1281 microversion: 2.20 time: 0.142171 Aug 29 23:59:52.238154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:52.238978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:52.244977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 15/30] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:52 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:52.249878 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:52.250606 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:52.251122 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:52.252778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:52.253305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:52.253886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:52.525159 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:52.562122 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-76a2382f-290c-41bb-aa8a-9c25124d8732 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1226 microversion: 2.1 time: 0.325983 Aug 29 23:59:52.562917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 16/31] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:52 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1226 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:52.661516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:52.662129 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:52.674923 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:52.675658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:52.677470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:52.678872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:52.679514 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:52.692008 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:53.013529 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:53.042491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-373f2c28-aa97-40c7-acbe-895fa2c0bc62 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1219 microversion: 2.1 time: 0.381479 Aug 29 23:59:53.043104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 16/32] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:52 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1219 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:53.244646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0d694b9c-99c6-49ee-ae58-0215fb5c2d28 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:53.245324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0d694b9c-99c6-49ee-ae58-0215fb5c2d28 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:53.385024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0d694b9c-99c6-49ee-ae58-0215fb5c2d28 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:53.408054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0d694b9c-99c6-49ee-ae58-0215fb5c2d28 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:53.411608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0d694b9c-99c6-49ee-ae58-0215fb5c2d28 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:53.412669 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-91031577", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1daca9fc-b41f-47af-b248-ac12ba6e5bb7"}], "security_groups": [{"name": "tempest-securitygroup--1265505252"}], "key_name": "tempest-keypair-1833504788", "user_data": "}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:53.414326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0d694b9c-99c6-49ee-ae58-0215fb5c2d28 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1281 microversion: 2.20 time: 0.178282 Aug 29 23:59:53.415697 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 17/33] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:53 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:53.587850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:53.588461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:53.607098 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:53.614735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:53.615283 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:53.616037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:53.616510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:53.616949 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:53.802164 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:53.823067 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f182e34b-450c-4346-ac15-ae9ec31aca10 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1274 microversion: 2.1 time: 0.232418 Aug 29 23:59:53.826839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 18/34] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:53 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1274 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:54.010335 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] validate_networks() for [('1daca9fc-b41f-47af-b248-ac12ba6e5bb7', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:59:54.068152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:54.069078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:54.083939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.085735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.087291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.091221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.093379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.094037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.280861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:54.310975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-57662fac-3ebf-4ff6-bddf-24e14cb9400e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1267 microversion: 2.1 time: 0.250331 Aug 29 23:59:54.318668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 19/35] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:54 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:54.438432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:54.439313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:54.464639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.481209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.487783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.487783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:54.487783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:54.487783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:54.956846 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:54.990721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:54.992743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:55.009669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f32c43c3-0eae-4cca-b795-6402be74ce0d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1285 microversion: 2.20 time: 0.575749 Aug 29 23:59:55.010279 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 20/36] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:54 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1285 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:55.029032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:55.029673 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:55.055793 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.056345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.056874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.064679 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.065366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.066541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.211470 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:55.222426 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b46c8880-92e4-46f9-aeeb-f40e7917a9a1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1282 microversion: 2.1 time: 0.211070 Aug 29 23:59:55.223638 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 21/37] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:55 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:55.313788 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:59:55.314844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:59:55.315461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:59:55.316043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:59:55.316633 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:59:55.329010 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.330634 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.338509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.338509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.338509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.338509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.345541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:55.346423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:55.360911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:59:55.362255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.363933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.367647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.370088 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:55.370778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:55.372120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:55.378102 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for user 3f27121b3ab54d5194dedcbe4b112727 and project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:59:55.412459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:59:55.418079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:59:55.531787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:55.547035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fd638438-6aee-40a4-93df-411e16d78a38 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1285 microversion: 2.1 time: 0.205888 Aug 29 23:59:55.554870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 22/38] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:55 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:55.655875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f0c1446b-3207-4c31-88bf-26945d131464 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.248235 Aug 29 23:59:55.666793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 17/39] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Aug 29 23:59:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:59:55.672803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b5fd8f9b-ee9d-4747-b7b1-5b03a746d5fa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:55.672803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b5fd8f9b-ee9d-4747-b7b1-5b03a746d5fa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:55.780522 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b5fd8f9b-ee9d-4747-b7b1-5b03a746d5fa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:55.787629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b5fd8f9b-ee9d-4747-b7b1-5b03a746d5fa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1236 microversion: 2.1 time: 0.122416 Aug 29 23:59:55.789144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 23/40] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:55 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1236 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:56.042144 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:56.043288 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:56.049197 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.049669 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.050331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:56.051000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.051448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.051863 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:56.122800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:56.130964 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:56.132440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:56.133537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4c2b89e0-744c-475c-a98b-67b04401cf7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1277 microversion: 2.20 time: 0.095320 Aug 29 23:59:56.134093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 18/41] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:56 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:56.243970 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:56.244781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:56.252474 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.253130 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.253566 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:56.254616 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.255481 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.256547 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:56.325651 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:56.336757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ee545705-0311-4d81-b698-533ca9a8b01e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1282 microversion: 2.1 time: 0.094223 Aug 29 23:59:56.336757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 24/42] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:56 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:56.571018 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:56.571660 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:56.578343 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.578843 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.579288 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:56.579983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:56.580612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:56.582723 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:56.659057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:56.667385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ffb22cf3-48bb-4326-94d2-6720b5e1ed66 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1285 microversion: 2.1 time: 0.100712 Aug 29 23:59:56.667923 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 19/43] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:56 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:56.812098 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-bc8316f5-c943-4e7b-afe5-d23b4d9c1164 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:56.812915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-bc8316f5-c943-4e7b-afe5-d23b4d9c1164 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:56.874091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-bc8316f5-c943-4e7b-afe5-d23b4d9c1164 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:56.882087 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-bc8316f5-c943-4e7b-afe5-d23b4d9c1164 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1236 microversion: 2.1 time: 0.076248 Aug 29 23:59:56.895843 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 25/44] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:56 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:57.157865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:57.158606 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:57.165282 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.165945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.166382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.170526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.170526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.170526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.234903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:57.243508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:57.244986 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:57.246074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-874e5e4d-5c73-440b-bf2d-2e66a2a5caeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1277 microversion: 2.20 time: 0.092909 Aug 29 23:59:57.246786 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 20/45] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:57 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:57.355383 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:57.356006 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:57.361734 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.362219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.362706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.363395 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.363850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.364274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.432974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:57.440834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8f25b4bf-75ca-4f24-abff-1fd86b81da94 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1282 microversion: 2.1 time: 0.089238 Aug 29 23:59:57.441404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 26/46] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:57 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:57.731559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:57.731559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:57.731559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.731559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.733180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.733180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.733180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.733180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.787307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:57.799449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-eb4a68a1-de62-4ce1-bdcf-df73e8556f26 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1285 microversion: 2.1 time: 0.113325 Aug 29 23:59:57.802900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 21/47] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:57 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:57.906981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:57.907665 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:57.914407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:57.925504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.929608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.930415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:57.931432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:57.932216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:57.934046 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.270084 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:58.271381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:58.294570 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.307308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.312157 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.315026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.315954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.317809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.463787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:58.473575 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:58.479190 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:58.481632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:58.486063 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-94b039a8-459b-4a7f-8760-f44fac6dbeee tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1277 microversion: 2.20 time: 0.218303 Aug 29 23:59:58.489266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 22/48] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:58 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:59:58.490928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5487045d-8512-41f2-ae32-2f0ffef3ba2f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1240 microversion: 2.1 time: 0.589279 Aug 29 23:59:58.491727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 27/49] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:57 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1240 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:58.501389 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:58.502072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:58.513556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.514778 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.515390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.516267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.516866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.517441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.659868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:58.682005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6190bca2-b2d2-404e-9876-bb6c65bd8114 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1282 microversion: 2.1 time: 0.191604 Aug 29 23:59:58.682993 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 23/50] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:58 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:58.831842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:58.832725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:58.850769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.851637 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.852348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.853299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:58.853948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:58.854775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:58.944147 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:58.956516 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7dc004de-293e-444b-b493-6652a32f32f8 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1285 microversion: 2.1 time: 0.131990 Aug 29 23:59:58.968648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 28/51] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:58 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:59.509725 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:59.510540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:59.517808 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.518397 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.518956 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.519751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.520108 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:59.520426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.520778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:59.521526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.530106 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.530950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.531922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.533270 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.533971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.534435 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.593959 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:59.602080 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:59.603049 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:59.604861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:59.606652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2a146766-7edc-4e5f-b62c-f3aaca243efc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1277 microversion: 2.20 time: 0.100973 Aug 29 23:59:59.608272 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 24/52] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:59 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:59.610991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7a15cbd3-acf5-40b3-8684-27eb4fbe3ce3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1240 microversion: 2.1 time: 0.098968 Aug 29 23:59:59.611728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 29/53] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:59 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:59.711356 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:59.712040 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:59.718567 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.719240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.719881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.720568 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:59.721164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:59.721583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:59.786078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:59.794426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-808370b6-51dd-44d0-8b82-491e57d3f041 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1282 microversion: 2.1 time: 0.087016 Aug 29 23:59:59.795554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 25/54] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:59 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:59:59.989485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:59.990134 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:59.999893 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.004520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.005194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.007408 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.008039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.012458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.198499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:00.219559 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fe2b3f02-074c-46ee-944d-9ad420324bc9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1285 microversion: 2.1 time: 0.230333 Aug 30 00:00:00.231507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 30/55] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Aug 29 23:59:59 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:00.632990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:00.633595 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:00.644121 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:00.645569 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:00.668007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.668313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.673469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.675943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.676967 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.677518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.681686 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.682225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.687871 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.688022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.688022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.688022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.926857 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:00.941223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:00.942142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:00.947433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a3ac8efb-3583-4ad5-8604-01553c21f57c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1333 microversion: 2.20 time: 0.320781 Aug 30 00:00:00.952966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 26/56] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:00 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1333 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:00.967035 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:00.969860 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:00.982845 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.983550 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.987491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:00.988400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:00.988979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:00.989530 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:01.073649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:01.107865 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d44a27e8-2596-43ce-8a16-3dc0b0b292ac tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1240 microversion: 2.1 time: 0.461152 Aug 30 00:00:01.107865 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 31/57] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:00 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1240 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:01.231158 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:01.231158 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-899aa6fe-5497-4476-a9df-d154cf4219bc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1292 microversion: 2.1 time: 0.249482 Aug 30 00:00:01.231158 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 27/58] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:00 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1292 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:01.245096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:01.247112 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:01.261587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:01.262102 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:01.262748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:01.264431 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:01.265202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:01.266254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:01.458412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-695e45c6-6d5e-4aa0-9904-8afbb684cdd0 req-323f67cf-69ac-482d-9a1b-7b966938e849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df5b062-9099-42fa-9bcc-40d56163ce2b", "tag": "8816fffa-9f4f-44df-9179-ead1fe82bcc3"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:01.486291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-695e45c6-6d5e-4aa0-9904-8afbb684cdd0 req-323f67cf-69ac-482d-9a1b-7b966938e849 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:01.487282 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-695e45c6-6d5e-4aa0-9904-8afbb684cdd0 req-323f67cf-69ac-482d-9a1b-7b966938e849 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:01.488979 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-695e45c6-6d5e-4aa0-9904-8afbb684cdd0 req-323f67cf-69ac-482d-9a1b-7b966938e849 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:01.524353 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-695e45c6-6d5e-4aa0-9904-8afbb684cdd0 req-323f67cf-69ac-482d-9a1b-7b966938e849 service nova] Creating event network-changed:8816fffa-9f4f-44df-9179-ead1fe82bcc3 for instance 3df5b062-9099-42fa-9bcc-40d56163ce2b on hv-cinder-85427 Aug 30 00:00:01.525534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-695e45c6-6d5e-4aa0-9904-8afbb684cdd0 req-323f67cf-69ac-482d-9a1b-7b966938e849 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 00:00:01.525928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-695e45c6-6d5e-4aa0-9904-8afbb684cdd0 req-323f67cf-69ac-482d-9a1b-7b966938e849 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 00:00:01.527519 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:01.528037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:01.528665 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:01.529770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:01.530321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:01.530928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:01.543267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.compute.rpcapi [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 00:00:01.544551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] Releasing lock "compute-rpcapi-router" {{(pid=127769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 00:00:01.572157 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e62f6fc1-0079-4e1b-8231-d0e918c1bbef None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474551 Aug 30 00:00:01.573133 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 32/59] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:01.709714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:01.722310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-495e550f-77c0-4ea7-9f34-76134729fc8c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.483056 Aug 30 00:00:01.723212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 28/60] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:01 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:01.977317 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:01.978001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:02.000910 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.004720 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.006845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.007809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.008867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.010756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.117426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:02.124632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:02.136550 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.137039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.141532 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.144901 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.145683 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.151425 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.688632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:02.692008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:02.703579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:02.705284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:02.707111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c306e703-671a-42e6-96a1-fbba2c0074fb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1341 microversion: 2.20 time: 0.734024 Aug 30 00:00:02.718896 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7457be0d-3e31-4d68-98e7-b49dcfef81f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1288 microversion: 2.1 time: 0.596732 Aug 30 00:00:02.720492 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 33/61] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:01 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1341 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:02.733479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:02.734514 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:02.739729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 29/62] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:02 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1288 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:02.742649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.745208 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.745208 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.745208 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.746325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.746941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.758073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:02.758712 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:02.789635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.803294 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.803744 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:02.804478 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:02.804927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:02.805348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:03.285152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:03.289068 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:03.299126 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-954b255c-d82a-4189-b4f5-f45ea77ee185 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.577125 Aug 30 00:00:03.299978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 34/63] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:02 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:03.527233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:03.538738 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-181548d3-bfd7-4a68-9bd1-9d8c4ede08fb tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.796553 Aug 30 00:00:03.539467 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 30/64] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:02 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:03.737466 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:03.738023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:03.745053 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:03.747729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:03.747729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:03.747729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:03.747729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:03.748115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:03.755798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:03.756389 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:03.764020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:03.764524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:03.765014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:03.765740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:03.766199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:03.767591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:03.859455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:03.870220 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:03.880179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-af3f35e3-1fb6-4ac3-bc1a-31e9111f4e28 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1296 microversion: 2.1 time: 0.125747 Aug 30 00:00:03.880179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 31/65] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:03 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:03.897199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:03.906370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:03.909185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:03.910562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2416014a-66a9-4c75-85a2-7f84ad08453d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1339 microversion: 2.20 time: 0.177066 Aug 30 00:00:03.911363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 35/66] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:03 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:04.245508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-26410f68-8150-45a4-ae28-0ae3f5dc6aa6 req-d90360da-3f46-4b94-a0a7-e5b78175602c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acc0a09-67e0-4d32-9078-cef31f93aaa2", "tag": "bde78a3d-e8ef-49e0-83b4-e3f38628717b"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:04.271783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-26410f68-8150-45a4-ae28-0ae3f5dc6aa6 req-d90360da-3f46-4b94-a0a7-e5b78175602c service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.272744 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-26410f68-8150-45a4-ae28-0ae3f5dc6aa6 req-d90360da-3f46-4b94-a0a7-e5b78175602c service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.275256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-26410f68-8150-45a4-ae28-0ae3f5dc6aa6 req-d90360da-3f46-4b94-a0a7-e5b78175602c service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.331693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:04.332303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:04.340284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-26410f68-8150-45a4-ae28-0ae3f5dc6aa6 req-d90360da-3f46-4b94-a0a7-e5b78175602c service nova] Creating event network-changed:bde78a3d-e8ef-49e0-83b4-e3f38628717b for instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 on hv-cinder-85427 Aug 30 00:00:04.342617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-26410f68-8150-45a4-ae28-0ae3f5dc6aa6 req-d90360da-3f46-4b94-a0a7-e5b78175602c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127768) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 00:00:04.346810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-26410f68-8150-45a4-ae28-0ae3f5dc6aa6 req-d90360da-3f46-4b94-a0a7-e5b78175602c service nova] Acquired lock "compute-rpcapi-router" {{(pid=127768) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 00:00:04.348323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.348799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.349228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.350227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.351035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.351468 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.352010 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.352350 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.352527 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.352964 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.354034 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.354705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.381189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.compute.rpcapi [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 00:00:04.383385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] Releasing lock "compute-rpcapi-router" {{(pid=127768) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 00:00:04.424749 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d7dea3b9-2f51-4844-becd-620db9357008 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180324 Aug 30 00:00:04.424749 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 32/67] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:00:04.544111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:04.551881 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-18232fd8-4df3-4d10-823f-8812d0f5fc3a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.228281 Aug 30 00:00:04.552567 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 36/68] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:04 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:04.566125 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:04.567215 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:04.574226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.574805 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.575338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.576546 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.577323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.577740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.684467 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-7ebebf9f-9424-4e33-99a1-e476aa11a929 req-f8861b78-8f05-4618-8147-97600215d23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4298fd8b-9a35-465c-8e05-8d321d59e567", "tag": "b33c0e15-3bb4-46a9-bcf3-89f592d40e18"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:04.695080 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7ebebf9f-9424-4e33-99a1-e476aa11a929 req-f8861b78-8f05-4618-8147-97600215d23d service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.695680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7ebebf9f-9424-4e33-99a1-e476aa11a929 req-f8861b78-8f05-4618-8147-97600215d23d service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.696029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7ebebf9f-9424-4e33-99a1-e476aa11a929 req-f8861b78-8f05-4618-8147-97600215d23d service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.709303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-7ebebf9f-9424-4e33-99a1-e476aa11a929 req-f8861b78-8f05-4618-8147-97600215d23d service nova] Creating event network-changed:b33c0e15-3bb4-46a9-bcf3-89f592d40e18 for instance 4298fd8b-9a35-465c-8e05-8d321d59e567 on hv-cinder-85427 Aug 30 00:00:04.714699 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-7ebebf9f-9424-4e33-99a1-e476aa11a929 req-f8861b78-8f05-4618-8147-97600215d23d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097598 Aug 30 00:00:04.715601 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 37/69] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:00:04.790029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:04.799197 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-767341be-a184-4f82-bf3a-fbe0a8649a63 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.239347 Aug 30 00:00:04.812064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 33/70] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:04 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:04.901600 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:04.902294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:04.909087 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.909562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.909993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.910698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.911148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.911574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.938747 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:04.939730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:04.942735 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:04.946042 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.946534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.946960 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.947636 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:04.948074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:04.948484 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:04.987401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:04.999808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d05150c1-69dd-4ba6-9cdb-fa200ed1e0da tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1296 microversion: 2.1 time: 0.101962 Aug 30 00:00:05.000699 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 38/71] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:04 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:05.045542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:05.054688 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:05.056149 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:05.057259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4e6ec06d-3e53-41c9-88b8-c8bf5066f0cc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1339 microversion: 2.20 time: 0.122416 Aug 30 00:00:05.057821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 34/72] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:04 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:05.574047 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:05.574706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:05.581441 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:05.581923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:05.582553 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:05.583251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:05.583698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:05.584341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:05.725226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:05.733461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-188a9bd5-65f2-4fd3-b713-4bd56cfb86ee tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.164002 Aug 30 00:00:05.734028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 39/73] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:05 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:05.818939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:05.819545 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:05.821739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=24 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:05.826723 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:05.827199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:05.827628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:05.828307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:05.828751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:05.829168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:05.988691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:05.996197 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c5f06b63-8859-4af1-8c24-c22257ecf9dd tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.181417 Aug 30 00:00:05.996759 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 35/74] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:05 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:06.021986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:06.026628 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:06.029274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.029750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.030202 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.030913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.031362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.031776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.082891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:06.082891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:06.087492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.087979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.092185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.092185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.092185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.092185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.110850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:06.122231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-47290e33-db09-46b9-8048-01cc2f3952f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1296 microversion: 2.1 time: 0.100669 Aug 30 00:00:06.123276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 40/75] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:06 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:06.185891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:06.194278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:06.198025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:06.200881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-61b8c138-ecf9-4de6-a72e-2b405e823024 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1339 microversion: 2.20 time: 0.124128 Aug 30 00:00:06.201452 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 36/76] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:06 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:06.756639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:06.756639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:06.770448 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.770879 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.771725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.772633 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:06.773259 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:06.773857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:06.879187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=32 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:07.012658 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:07.019451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:07.020076 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:07.033813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.033813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.033813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.033813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.034158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-284df1b0-b63f-4231-b61b-0585d266e87a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.280792 Aug 30 00:00:07.034678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.034678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.034831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 41/77] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:06 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:07.164247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:07.164931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:07.181910 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.182411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.183705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.184426 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.185435 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.185874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.286127 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:07.304195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e4432496-6335-4447-a91d-b57b601eb89b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1296 microversion: 2.1 time: 0.148099 Aug 30 00:00:07.304389 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:07.314770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:07 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1296 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:07.337583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-aff972c7-b7ce-4963-8dac-d23e39c6fb51 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.324616 Aug 30 00:00:07.342990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:07.345146 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:07.351971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 37/79] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:07 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:07.359771 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.361996 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.365357 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.368087 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:07.368724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:07.372244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:07.647027 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:07.658020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:07.677723 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:07.683761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-887c44fb-ecc9-4eee-be89-7802ebdda887 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1339 microversion: 2.20 time: 0.367018 Aug 30 00:00:07.698095 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 43/80] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:07 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1339 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:08.055259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:08.056364 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:08.065127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:08.065626 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:08.066063 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:08.067189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:08.068276 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:08.068860 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:08.316937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:08.318390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:08.329582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:08.330390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:08.331441 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:08.336738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:08.340870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:08.343282 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:08.771423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:08.785416 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-27fbdb9a-5a8d-4b57-9d7b-90319e8544ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1294 microversion: 2.1 time: 0.472086 Aug 30 00:00:08.786660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 44/81] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:08 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1294 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:08.794917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:08.795801 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:08.829197 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:08.831265 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:08.835203 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:08.841944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:08.841944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:08.844669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:09.414922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:09.425392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ac8ce31c-1a7e-452a-a087-af82b1931474 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.637261 Aug 30 00:00:09.426497 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 45/82] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:08 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:09.432309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:09.433453 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:09.442817 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:09.443489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:09.444090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:09.444941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:09.445591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:09.446273 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:09.523973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:09.534316 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-61283277-d4b9-4752-82d7-0bb1496a1476 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 1.483397 Aug 30 00:00:09.534950 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 38/83] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:08 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:09.653659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:09.669148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:09.671596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:09.673513 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8863d67f-daec-4198-a4c3-2c8b2584c770 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1339 microversion: 2.20 time: 0.245062 Aug 30 00:00:09.674819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 46/84] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:09 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:09.819378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:09.821724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:09.833284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:09.838214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:09.838214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:09.838214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:09.838214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:09.838579 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.024794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.043584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-425c2164-7bc2-49e3-90ed-cd9b62180e7f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1294 microversion: 2.1 time: 0.229853 Aug 30 00:00:10.044673 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 39/85] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:09 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1294 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:10.448620 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:10.449335 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:10.456707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.457852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.458563 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.459699 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.460335 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.460940 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.562865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:10.564550 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:10.583222 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.583691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.584302 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.585434 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.586301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.587109 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.642693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.650366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9ea7310b-7aad-4987-97a5-a228c592fdb1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.206069 Aug 30 00:00:10.650986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 47/86] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:10 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:10.703897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:10.704503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:10.722258 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.722889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.727103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.727103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.727103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.727103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.888364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.890096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.898095 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9cf4ce6a-266f-47ad-b6af-8a81c8c4f23c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.340437 Aug 30 00:00:10.898910 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 40/87] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:10 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:10.920529 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.922014 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.923194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-da741729-4b02-4847-8f9d-23daf1ab78ff tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.224381 Aug 30 00:00:10.930942 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 48/88] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:10 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:11.073245 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:11.073904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:11.080362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.080842 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.081275 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.081961 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.082519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.082952 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.248483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:11.258153 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8710dca3-7f19-40f1-8ae3-4dbd3edd2253 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.188733 Aug 30 00:00:11.258767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 41/89] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:11 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:11.671426 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:11.675094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:11.675094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=8 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:11.678880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.679358 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.679789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.680469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.680919 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.681347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.811811 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:11.819456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b231dfb0-9462-4433-99ba-c0c4986069a0 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.152610 Aug 30 00:00:11.820022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 49/90] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:11 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:11.920317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:11.920931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:11.926987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.927464 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.927894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.928643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.929089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.929505 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.952048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:11.952650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:11.958798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.962100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.962100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.962100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.962100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.962424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.066322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.073879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f374fbd2-2228-4039-9da9-639db915bfc1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.158083 Aug 30 00:00:12.078732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 42/91] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:11 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:12.094968 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.103085 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.104534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.105637 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-72fd22ac-9518-4a4a-82d7-30e33ce0973c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.157737 Aug 30 00:00:12.106216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 50/92] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:11 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:12.279910 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:12.280449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:12.286654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.287126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.287551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.288225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.288666 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.289149 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.415846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.423583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-19417c51-fef2-4698-9c0a-b595ded89ce7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.148041 Aug 30 00:00:12.424151 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 43/93] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:12 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:12.840030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:12.840644 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:12.846694 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.847178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.847613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.848307 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.848757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.849181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.004721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.021187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-90c00f35-e2a6-419b-91fc-fa15cbe3951d tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.185004 Aug 30 00:00:13.022292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 51/94] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:12 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:13.102770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:13.103995 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:13.114125 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.114833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.115211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.116024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.116656 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.117070 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.129266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:13.129938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:13.137368 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.137874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.139205 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.139949 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.140401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.140828 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.145709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:13.318721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.327933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.329663 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.330888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dd81c239-7e21-43b4-a057-3a21db623762 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.205446 Aug 30 00:00:13.332044 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 52/95] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:13 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:13.444280 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:13.444880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:13.451744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.452223 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.452652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.453338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.453781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.454192 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.517605 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.536389 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e5e468b6-ef1f-4b4f-b7ad-84ec374bfb72 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.440214 Aug 30 00:00:13.536980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 44/96] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:13 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:13.602394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:13.610341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-54c021a3-8fa1-43c3-a12f-a8403cb747b1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.169885 Aug 30 00:00:13.610951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 53/97] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:13 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:14.045683 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:14.046324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:14.052407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.052987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.053424 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.054119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.054606 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.055029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.320474 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.328161 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f881c422-0a0b-43bf-968c-ec2982f4154f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.287299 Aug 30 00:00:14.328738 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 45/98] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:14 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:14.355385 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:14.356012 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:14.362584 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.363059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.363484 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.364165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.364611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.365027 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.529543 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.539855 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.541616 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.542928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e4ca42b3-a3d7-40b4-a2d6-bba2ecad7972 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.191520 Aug 30 00:00:14.543520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 54/99] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:14 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:14.564325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:14.564810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:14.569686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=6 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:14.571751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.572402 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.573397 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.574835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.576011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.576765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.632978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:14.634619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:14.645735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.646952 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.647744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.648694 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.649485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.650100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.814156 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.826686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3eb9a455-8bf2-466c-9817-966134d549c7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.270307 Aug 30 00:00:14.827372 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.836353 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0e64b177-5a33-420e-b04a-581817520116 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.208669 Aug 30 00:00:14.837120 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 46/100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:14 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:14.840537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 55/101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:14 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:14.844254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-97eb6d7c-263c-41f7-906d-fba171701e0d req-8cf14ef5-675c-40f6-86d0-c8c7f99097b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68880fbb-7000-4185-b41d-5b4241962ca9", "tag": "dde5c265-f836-4880-9c73-bb362497cb0f"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:14.856886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-97eb6d7c-263c-41f7-906d-fba171701e0d req-8cf14ef5-675c-40f6-86d0-c8c7f99097b9 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:14.858135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-97eb6d7c-263c-41f7-906d-fba171701e0d req-8cf14ef5-675c-40f6-86d0-c8c7f99097b9 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:14.858613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-97eb6d7c-263c-41f7-906d-fba171701e0d req-8cf14ef5-675c-40f6-86d0-c8c7f99097b9 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.869929 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-97eb6d7c-263c-41f7-906d-fba171701e0d req-8cf14ef5-675c-40f6-86d0-c8c7f99097b9 service nova] Creating event network-changed:dde5c265-f836-4880-9c73-bb362497cb0f for instance 68880fbb-7000-4185-b41d-5b4241962ca9 on hv-cinder-85427 Aug 30 00:00:14.876488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-97eb6d7c-263c-41f7-906d-fba171701e0d req-8cf14ef5-675c-40f6-86d0-c8c7f99097b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036875 Aug 30 00:00:14.877524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 47/102] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:15.350344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:15.351255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:15.363568 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.365995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.371441 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.373054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.373728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.374356 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.541377 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:15.556400 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f0798afb-126a-413b-aa83-abe2d006689e tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.208878 Aug 30 00:00:15.556400 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 56/103] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:15 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:15.577823 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:15.583686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:15.598366 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.600348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.601128 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.603144 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.605861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.607073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.847639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:15.848796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:15.860323 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.861048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.867750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.868924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.869541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.870113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.134069 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.143306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e1e2a2eb-16ae-4e9b-ba4d-461d7a24defc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.299320 Aug 30 00:00:16.147794 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 57/104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:15 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:16.155428 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:16.156041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:16.168702 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.169608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.171334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.172392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.172953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.173439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.375304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.383702 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a3844ef2-ce0c-4630-b804-088f1e0a2b87 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.234672 Aug 30 00:00:16.384562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 58/105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:16 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:16.395496 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.407167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.408839 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.410405 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5d9faac2-32c2-40db-a6ea-ad32c2dc2229 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.844650 Aug 30 00:00:16.411044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 48/106] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:15 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:16.582123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:16.582709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:16.588809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.589296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.589742 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.590437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.591074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.591492 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.732097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.740220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d3a0ce6d-8bf2-4727-8e2b-292f2e8dac52 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.162260 Aug 30 00:00:16.740804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 59/107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:16 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:16.891448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-9d4e8316-5b41-4499-bb17-e2051fc17303 req-5e073c77-aa27-4de1-9565-a5e3b12c34c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa3cd3e-c701-4851-a613-4c89ea690072", "tag": "7aa950fd-42ef-47f2-90db-cffca1a6595c"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:16.900662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9d4e8316-5b41-4499-bb17-e2051fc17303 req-5e073c77-aa27-4de1-9565-a5e3b12c34c7 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.901346 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9d4e8316-5b41-4499-bb17-e2051fc17303 req-5e073c77-aa27-4de1-9565-a5e3b12c34c7 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.901766 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9d4e8316-5b41-4499-bb17-e2051fc17303 req-5e073c77-aa27-4de1-9565-a5e3b12c34c7 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.916622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-9d4e8316-5b41-4499-bb17-e2051fc17303 req-5e073c77-aa27-4de1-9565-a5e3b12c34c7 service nova] Creating event network-changed:7aa950fd-42ef-47f2-90db-cffca1a6595c for instance bfa3cd3e-c701-4851-a613-4c89ea690072 on hv-cinder-85427 Aug 30 00:00:16.921658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-9d4e8316-5b41-4499-bb17-e2051fc17303 req-5e073c77-aa27-4de1-9565-a5e3b12c34c7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034571 Aug 30 00:00:16.922257 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 49/108] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:17.171696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:17.172432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:17.178860 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.179338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.182593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.182593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.182593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.182593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.338327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:17.346042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3949e232-4189-4442-ab46-1808a75dc768 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.178670 Aug 30 00:00:17.346639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 60/109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:17 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:17.405519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:17.406224 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:17.412455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.412917 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.413344 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.414022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.414490 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.415740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.419027 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:17.439420 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:17.440543 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:17.446823 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.447295 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.448037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.452857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.452857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.452857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.593614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:17.601843 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:17.603718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:17.603866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:17.604827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aaa1cdea-7661-4de3-bc36-fbd7bf1b1de6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.171689 Aug 30 00:00:17.605379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 61/110] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:17 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:17.612733 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bfb98799-fd12-4c68-8795-869b75a0840a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.210944 Aug 30 00:00:17.613295 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 50/111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:17 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:17.762436 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:17.763048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:17.769567 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.770029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.770538 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.771222 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.771796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.772109 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.906300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:17.913900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-96fc14a1-a9d6-444e-b45f-2a652bff0ff1 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.155826 Aug 30 00:00:17.914462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 62/112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:17 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:18.366876 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:18.367394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:18.373488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.373967 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.374397 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.375131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.375582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.376000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.511387 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:18.519872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-25ec6c06-8817-4934-87c0-20ef9bc8a47e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.157351 Aug 30 00:00:18.520437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 51/113] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:18 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:18.629188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:18.629809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:18.634238 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:18.634866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:18.638048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.638997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.639419 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.640145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.640531 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.641005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.642038 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.642596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.643031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.643729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.644182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.644604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.781804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:18.791292 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:18.797039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:18.797039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:18.797281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b1b90583-be4f-4336-a0a8-716e499c646a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.173035 Aug 30 00:00:18.802540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 63/114] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:18 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:18.802680 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-78156064-78f9-4d2d-a9e1-11abe7224224 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.170003 Aug 30 00:00:18.802680 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 52/115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:18 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:18.935119 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:18.935728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:18.941931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.942411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.942889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.943576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:18.944029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:18.944454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.075963 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.083476 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aa0a3513-596f-4ea1-9e80-e9d44cc9506a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.152254 Aug 30 00:00:19.084041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 64/116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:18 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:19.541018 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:19.541999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:19.548521 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.549070 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.549581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.550362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.550899 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.551382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.693209 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.700859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d20194a1-31a7-474e-bb2e-0150d2789e7e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.163659 Aug 30 00:00:19.701422 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 53/117] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:19 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:19.819462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:19.820061 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:19.821549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:19.822217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:19.826712 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.827175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.827596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.828274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.828717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.828890 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.829124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.829363 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.829787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.830458 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.830970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.831342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.975761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.984206 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.985693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.987056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9c2e5d06-639d-4dab-882f-dd1c98b32e76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.171482 Aug 30 00:00:19.997382 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 65/118] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:19 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:19.997643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.997851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cc67448b-d7b0-4539-8d2c-820efcc9289d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.180441 Aug 30 00:00:19.998612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 54/119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:19 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:20.104709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:20.105233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:20.112335 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.112826 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.113259 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.113946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.114611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.115190 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.264276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:20.294903 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5036bd85-3e6b-431b-9a39-b0b406947a08 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.193468 Aug 30 00:00:20.295999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 66/120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:20 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:20.691156 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-c5f6eac9-922a-4786-abce-7458eaea8102 req-9a1830d5-8b16-44f4-9a97-6c922b590669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acc0a09-67e0-4d32-9078-cef31f93aaa2", "name": "network-vif-plugged", "status": "completed", "tag": "bde78a3d-e8ef-49e0-83b4-e3f38628717b"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:20.708810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-c5f6eac9-922a-4786-abce-7458eaea8102 req-9a1830d5-8b16-44f4-9a97-6c922b590669 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.709297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-c5f6eac9-922a-4786-abce-7458eaea8102 req-9a1830d5-8b16-44f4-9a97-6c922b590669 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.710213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-c5f6eac9-922a-4786-abce-7458eaea8102 req-9a1830d5-8b16-44f4-9a97-6c922b590669 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.721632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:20.722233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:20.724100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-c5f6eac9-922a-4786-abce-7458eaea8102 req-9a1830d5-8b16-44f4-9a97-6c922b590669 service nova] Creating event network-vif-plugged:bde78a3d-e8ef-49e0-83b4-e3f38628717b for instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 on hv-cinder-85427 Aug 30 00:00:20.729030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.729701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.730282 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.730414 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-c5f6eac9-922a-4786-abce-7458eaea8102 req-9a1830d5-8b16-44f4-9a97-6c922b590669 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104857 Aug 30 00:00:20.730989 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 55/121] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:20.731509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.732111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.732582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.905994 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:20.913596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-25038618-30b5-4114-b8c4-d56e949913a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.195827 Aug 30 00:00:20.914185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 67/122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:20 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:21.022811 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:21.022914 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:21.022914 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:21.023320 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:21.033618 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.034221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.034746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.035024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.035168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.036044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.036639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.036777 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.037329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.038261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.039650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.040156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.222676 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:21.226804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:21.231378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6e84176f-372d-4556-a243-aba00e041dfe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.213936 Aug 30 00:00:21.231964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 68/123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:21 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:21.316627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:21.317506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:21.324015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.324840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.325951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.326853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.327585 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.328157 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.430259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:21.444365 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:21.446063 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:21.447287 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-15d09005-caed-4dcd-8218-b046f4b3a9fc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.429941 Aug 30 00:00:21.447846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 56/124] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:21 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:21.495975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:21.505102 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1228e3ba-6072-4ca7-98b3-363b6bc5bd27 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.192361 Aug 30 00:00:21.518723 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 69/125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:21 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:21.935004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:21.935782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:21.941971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.942574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.943222 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.944115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.944932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.945526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.099972 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.108975 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cac995f6-3bb0-4f40-abe9-e03b75695f59 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.178052 Aug 30 00:00:22.120775 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 57/126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:21 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:22.252153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:22.252780 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:22.262231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:22.262808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:22.263503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.264184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:22.264701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:22.265119 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.432026 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.442587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3d88170e-9062-429c-a9dd-da62cbd76020 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.194104 Aug 30 00:00:22.444070 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 70/127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:22 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:22.470143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:22.471296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:22.477900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:22.478724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:22.479255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.480042 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:22.480710 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:22.481489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.527980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:22.528823 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:22.538557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:22.544394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:22.544770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.551746 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:22.553119 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:22.555287 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.774731 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.783114 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.791189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.796071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.797199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e5e1d759-14c3-4ca4-917d-76262d0c186a tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.274069 Aug 30 00:00:22.798150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 71/128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:22 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:22.807004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7ce11a4f-6a6a-45a3-be98-ec0855f27b0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.332228 Aug 30 00:00:22.809682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 58/129] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:22 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:22.822034 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-f2569282-1d1c-4431-b51d-9aab8df96835 req-ac10ffb6-564e-47d6-824e-22b6f95b49ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df5b062-9099-42fa-9bcc-40d56163ce2b", "name": "network-vif-plugged", "status": "completed", "tag": "8816fffa-9f4f-44df-9179-ead1fe82bcc3"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:22.852653 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f2569282-1d1c-4431-b51d-9aab8df96835 req-ac10ffb6-564e-47d6-824e-22b6f95b49ef service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:22.853529 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f2569282-1d1c-4431-b51d-9aab8df96835 req-ac10ffb6-564e-47d6-824e-22b6f95b49ef service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:22.854186 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f2569282-1d1c-4431-b51d-9aab8df96835 req-ac10ffb6-564e-47d6-824e-22b6f95b49ef service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.873378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-f2569282-1d1c-4431-b51d-9aab8df96835 req-ac10ffb6-564e-47d6-824e-22b6f95b49ef service nova] Creating event network-vif-plugged:8816fffa-9f4f-44df-9179-ead1fe82bcc3 for instance 3df5b062-9099-42fa-9bcc-40d56163ce2b on hv-cinder-85427 Aug 30 00:00:22.878776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-f2569282-1d1c-4431-b51d-9aab8df96835 req-ac10ffb6-564e-47d6-824e-22b6f95b49ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078444 Aug 30 00:00:22.879486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 72/130] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:23.129656 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:23.130909 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:23.142396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.142919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.143331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.144023 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.144465 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.144879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.345259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:23.353588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1d2adb36-af22-4d23-979c-85d6929d841a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.228203 Aug 30 00:00:23.354172 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 59/131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:23 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:23.467103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:23.467803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:23.473962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.474440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.474906 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.475585 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.476036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.476455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.654584 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:23.663400 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fb1ad25c-0bff-4066-897f-835ee7a9c559 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.200974 Aug 30 00:00:23.663981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 73/132] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:23 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:23.823060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:23.823663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:23.830308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.830831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.831298 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.831981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.832433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.838981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.839187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:23.839187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:23.842052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.842583 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.843045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.843743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.844192 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.844809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.001077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.002124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.014701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.016343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.017031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6df7511f-5e26-4604-9d06-404593101479 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.197783 Aug 30 00:00:24.017596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e67d2f79-0c59-442b-8d34-0d86b4d5869a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.186420 Aug 30 00:00:24.024011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 74/133] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:23 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:24.026882 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 60/134] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:23 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:24.375686 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:24.376313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:24.382215 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.382735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.383168 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.383856 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.384302 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.384841 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.565611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.574082 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-27d18905-c676-4170-be06-74aac1c3a45e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1322 microversion: 2.1 time: 0.202776 Aug 30 00:00:24.574765 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 75/135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:24 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:24.688180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:24.688180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:24.693314 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.693872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.694394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.695185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.695705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.696196 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.896260 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-d083d39f-0e07-4494-ba5e-3ba57169b38a req-0bca1498-3dfc-4e62-ac45-e2748ae195c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4298fd8b-9a35-465c-8e05-8d321d59e567", "name": "network-vif-plugged", "status": "completed", "tag": "b33c0e15-3bb4-46a9-bcf3-89f592d40e18"}, {"server_uuid": "bfa3cd3e-c701-4851-a613-4c89ea690072", "name": "network-vif-plugged", "status": "completed", "tag": "7aa950fd-42ef-47f2-90db-cffca1a6595c"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:24.908051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-d083d39f-0e07-4494-ba5e-3ba57169b38a req-0bca1498-3dfc-4e62-ac45-e2748ae195c5 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.908531 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-d083d39f-0e07-4494-ba5e-3ba57169b38a req-0bca1498-3dfc-4e62-ac45-e2748ae195c5 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.909099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-d083d39f-0e07-4494-ba5e-3ba57169b38a req-0bca1498-3dfc-4e62-ac45-e2748ae195c5 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.909919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.918017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-15ea3f01-bf17-4767-8dc5-193c16ab7b96 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.236944 Aug 30 00:00:24.926497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 61/136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:24 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:24.926645 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-d083d39f-0e07-4494-ba5e-3ba57169b38a req-0bca1498-3dfc-4e62-ac45-e2748ae195c5 service nova] Creating event network-vif-plugged:b33c0e15-3bb4-46a9-bcf3-89f592d40e18 for instance 4298fd8b-9a35-465c-8e05-8d321d59e567 on hv-cinder-85427 Aug 30 00:00:24.926645 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-d083d39f-0e07-4494-ba5e-3ba57169b38a req-0bca1498-3dfc-4e62-ac45-e2748ae195c5 service nova] Creating event network-vif-plugged:7aa950fd-42ef-47f2-90db-cffca1a6595c for instance bfa3cd3e-c701-4851-a613-4c89ea690072 on hv-cinder-85427 Aug 30 00:00:24.930007 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-d083d39f-0e07-4494-ba5e-3ba57169b38a req-0bca1498-3dfc-4e62-ac45-e2748ae195c5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037624 Aug 30 00:00:24.930627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 76/137] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:25.049084 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:25.049759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.051607 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:25.052256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.056495 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:25.058248 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.059039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.059653 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.061179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.061814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.063021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.083426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.089129 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.090060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.094881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.096523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.098773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.241827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.253870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.259498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.259498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fc512c19-cdc7-455c-8523-8a90de42e269 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.212795 Aug 30 00:00:25.259498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 77/138] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:25 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:25.301785 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.310746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-43cf7a98-729b-4eaa-ad5c-00ef5922ed9c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.265757 Aug 30 00:00:25.311149 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 62/139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:25 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:25.594838 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:25.595581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.603532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.604188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.604737 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.605806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.606374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.606926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.748567 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.756290 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dec243e1-f703-42fc-aae9-e94833b4338b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1516 microversion: 2.1 time: 0.165439 Aug 30 00:00:25.757670 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 78/140] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:25 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:25.780415 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:25.782783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.789104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.789587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.790208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.791092 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.796315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.796315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.854611 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lazy-loading 'flavor' on Instance uuid 9acc0a09-67e0-4d32-9078-cef31f93aaa2 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:00:25.942348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:25.943312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.950587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.951063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.952586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.953429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.954169 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.954756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.156837 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:26.167900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ced0ade0-7187-44da-b214-f287c6fc1bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.230329 Aug 30 00:00:26.169902 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 79/141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:25 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:26.272321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d7b49347-4e6a-403c-92d7-e5aa8715c471 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2/action" status: 200 len: 32 microversion: 2.1 time: 0.495813 Aug 30 00:00:26.273966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 63/142] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:00:25 2022] POST /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2/action => generated 32 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:00:26.284849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:26.285715 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:26.287264 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:26.288171 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:26.292013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.294647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.295507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.296593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.296903 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.297476 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.297760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.297897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.298528 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.299450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.300278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.302035 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.544255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:26.552920 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0ca74103-a53d-4032-af26-30f1ee03445c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.273599 Aug 30 00:00:26.553786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 80/143] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:26 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:26.559723 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:26.560805 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:26.569949 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:26.574704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.574704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.575761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.576661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.577427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.578305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.579785 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:26.585702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:26.586965 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-23474d64-6c3e-4921-8227-16a9886c9c83 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.304733 Aug 30 00:00:26.589493 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 64/144] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:26 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:26.788171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:26.805069 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-24d2178c-2b83-44df-9a4e-edfb5fda2d03 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1315 microversion: 2.1 time: 0.249990 Aug 30 00:00:26.810639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 81/145] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:26 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:27.190536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:27.191830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:27.198600 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.199788 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.200965 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.201968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.202789 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.203672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.227651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:27.337305 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:27.345380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a9258743-c3ea-4fcb-816e-78193e8566fe tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.159981 Aug 30 00:00:27.345980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 65/146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:27 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:27.576615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:27.577427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:27.583947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.584618 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.585138 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.586004 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.586708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.587480 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.611820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:27.612420 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:27.619081 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.619654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.620079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.620940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.622164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.622613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.738759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:27.747960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2230e25c-d119-47b0-b07e-10e8e0306010 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.176092 Aug 30 00:00:27.750414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 82/147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:27 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:27.801727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:27.809837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:27.811432 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:27.812519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-060ef493-203a-4f50-962b-ad29702c4a93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1407 microversion: 2.20 time: 0.204578 Aug 30 00:00:27.813078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 66/148] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:27 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:00:27.832654 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:27.833727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:27.839752 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.840704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.841134 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.841807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.842254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.842699 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.045343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:28.053390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dfd04f8c-6d3c-404f-a467-77b260f34228 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1501 microversion: 2.1 time: 0.224624 Aug 30 00:00:28.066946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 83/149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:27 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:28.365540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:28.367037 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:28.373662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.376668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.378911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.381356 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.382008 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.382684 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.494861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-23b4b70a-2686-44f7-9599-c44f38a45824 req-381371bc-3ffa-4717-a961-caf840f19791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68880fbb-7000-4185-b41d-5b4241962ca9", "name": "network-vif-plugged", "status": "completed", "tag": "dde5c265-f836-4880-9c73-bb362497cb0f"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:28.513844 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-23b4b70a-2686-44f7-9599-c44f38a45824 req-381371bc-3ffa-4717-a961-caf840f19791 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.514317 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-23b4b70a-2686-44f7-9599-c44f38a45824 req-381371bc-3ffa-4717-a961-caf840f19791 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.514762 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-23b4b70a-2686-44f7-9599-c44f38a45824 req-381371bc-3ffa-4717-a961-caf840f19791 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.527112 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-23b4b70a-2686-44f7-9599-c44f38a45824 req-381371bc-3ffa-4717-a961-caf840f19791 service nova] Creating event network-vif-plugged:dde5c265-f836-4880-9c73-bb362497cb0f for instance 68880fbb-7000-4185-b41d-5b4241962ca9 on hv-cinder-85427 Aug 30 00:00:28.534113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-23b4b70a-2686-44f7-9599-c44f38a45824 req-381371bc-3ffa-4717-a961-caf840f19791 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042752 Aug 30 00:00:28.539219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 84/150] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:00:28.608172 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:28.617321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f4f89e15-5d7e-4cc3-bed9-3602b0450113 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.255486 Aug 30 00:00:28.623304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 67/151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:28 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:28.770490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:28.771205 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:28.778132 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.778714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.779206 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.779890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.780342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.780757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.837142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:28.837741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:28.871558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.872062 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.872493 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.873208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.877554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.877554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.015997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:29.033276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c0ca8793-91ba-4684-bd06-3dd1de431149 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.267043 Aug 30 00:00:29.049171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 85/152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:28 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:29.358828 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:29.370217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:29.373984 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:29.375205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-80e9c7aa-18cd-4ed0-b514-e24f5780f4e5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1598 microversion: 2.20 time: 0.542928 Aug 30 00:00:29.387143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 68/153] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:00:28 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1598 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:00:29.400692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:29.401512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:29.407640 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:29.408111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:29.408711 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.409551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:29.410177 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:29.410633 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.537742 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5e307ce3-f123-4d17-8b03-26086d1fe514 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142472 Aug 30 00:00:29.538558 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 86/154] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Aug 30 00:00:29 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:00:29.640554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:29.641163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:29.650255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:29.651164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:29.651815 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.653232 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:29.654153 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:29.655063 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.966492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:29.978484 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-352e1b1f-106c-4755-b7ae-8c7bbafd3f9b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1362 microversion: 2.1 time: 0.342664 Aug 30 00:00:29.980092 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 69/155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:29 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:30.050667 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cf33554-cf52-4af9-a624-6087ba726039"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:30.062954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:30.062954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:30.065620 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:30.072395 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:30.072878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:30.073308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:30.074007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:30.074506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:30.074920 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:30.082306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:30.083238 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:30.083828 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:30.084826 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:30.085478 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:30.086047 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:30.243542 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:30.341840 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:30.350457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-610fe1a4-4833-43fa-9593-371b6072799a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.294612 Aug 30 00:00:30.351894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 70/156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:30 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:31.001804 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:31.002436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:31.010685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:31.011666 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:31.014179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:31.019928 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:31.020303 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:31.020917 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:31.173968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:31.181906 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-145df799-612d-4510-a1e2-dc8c4f429ddb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1548 microversion: 2.1 time: 0.184138 Aug 30 00:00:31.182590 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 71/157] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:30 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:31.196325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1f07dbad-eca4-4696-84f6-8d1c422e62b9 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "POST /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.152416 Aug 30 00:00:31.203266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 87/158] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:00:30 2022] POST /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567/os-volume_attachments => generated 194 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:31.213744 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:31.223732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:31.234269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:31.234848 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:31.235288 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:31.236512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:31.237117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:31.237880 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:31.330229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-a2d972b8-f124-456d-990a-99e8308bb104 req-e406e992-6540-46ac-b775-366a79ae0717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa3cd3e-c701-4851-a613-4c89ea690072", "tag": "7aa950fd-42ef-47f2-90db-cffca1a6595c"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:31.343440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-a2d972b8-f124-456d-990a-99e8308bb104 req-e406e992-6540-46ac-b775-366a79ae0717 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:31.345544 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-a2d972b8-f124-456d-990a-99e8308bb104 req-e406e992-6540-46ac-b775-366a79ae0717 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:31.345544 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-a2d972b8-f124-456d-990a-99e8308bb104 req-e406e992-6540-46ac-b775-366a79ae0717 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:31.360297 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-a2d972b8-f124-456d-990a-99e8308bb104 req-e406e992-6540-46ac-b775-366a79ae0717 service nova] Creating event network-changed:7aa950fd-42ef-47f2-90db-cffca1a6595c for instance bfa3cd3e-c701-4851-a613-4c89ea690072 on hv-cinder-85427 Aug 30 00:00:31.365649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-a2d972b8-f124-456d-990a-99e8308bb104 req-e406e992-6540-46ac-b775-366a79ae0717 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040179 Aug 30 00:00:31.370851 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 88/159] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:31.386090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:31.389650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:31.391541 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-551f5760-3a63-481a-8a84-d9efeb5f68ae tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188583 Aug 30 00:00:31.398791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:31.400163 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:31.402245 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 72/160] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:00:31 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:31.411615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:31.413807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:31.414550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:31.415166 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:31.771892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:31.785179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2fc103fe-b4ea-4c75-901b-135d53e3c804 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.402910 Aug 30 00:00:31.786057 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 89/161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:31 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:32.811700 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:32.814357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:32.822805 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:32.823334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:32.823804 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:32.825142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:32.825662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:32.826096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:33.048956 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:33.052431 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-eeaf49c2-b4cb-4d54-819b-333f5ba5d520 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.245350 Aug 30 00:00:33.053453 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 73/162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:32 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:33.383581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-baf29720-dd2d-4a65-a8e7-d2a06aeae3c2 req-464424b3-0776-42f3-b3ec-e2ca3d24f007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68880fbb-7000-4185-b41d-5b4241962ca9", "tag": "dde5c265-f836-4880-9c73-bb362497cb0f"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:33.398016 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-baf29720-dd2d-4a65-a8e7-d2a06aeae3c2 req-464424b3-0776-42f3-b3ec-e2ca3d24f007 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:33.398897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-baf29720-dd2d-4a65-a8e7-d2a06aeae3c2 req-464424b3-0776-42f3-b3ec-e2ca3d24f007 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:33.399621 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-baf29720-dd2d-4a65-a8e7-d2a06aeae3c2 req-464424b3-0776-42f3-b3ec-e2ca3d24f007 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:33.413411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-baf29720-dd2d-4a65-a8e7-d2a06aeae3c2 req-464424b3-0776-42f3-b3ec-e2ca3d24f007 service nova] Creating event network-changed:dde5c265-f836-4880-9c73-bb362497cb0f for instance 68880fbb-7000-4185-b41d-5b4241962ca9 on hv-cinder-85427 Aug 30 00:00:33.420721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-baf29720-dd2d-4a65-a8e7-d2a06aeae3c2 req-464424b3-0776-42f3-b3ec-e2ca3d24f007 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041681 Aug 30 00:00:33.425167 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 90/163] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:34.073977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:34.075414 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:34.081905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:34.082407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:34.082939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:34.083746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:34.084260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:34.084771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:34.249140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:34.260817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c1d06fd1-0b0c-48ec-9317-b9c9ed9f10f9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.190409 Aug 30 00:00:34.278051 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 74/164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:34 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:35.286396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:35.287128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:35.294029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:35.294527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:35.294968 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:35.295656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:35.296094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:35.296518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:35.444274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:35.455058 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b5177974-c866-49c9-befa-1adf6f33c5d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.170345 Aug 30 00:00:35.455058 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 91/165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:35 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:36.474486 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:36.475713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:36.485965 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:36.489637 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:36.490264 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:36.492185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:36.492648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:36.493068 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:36.708939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:36.717622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7afb8e49-17eb-45aa-b206-5646aa4cae58 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.247185 Aug 30 00:00:36.718256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 75/166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:36 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:37.741389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:37.741988 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:37.748749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:37.749376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:37.749670 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:37.750354 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:37.750827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:37.751248 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:37.948168 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:37.956742 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0b8413df-7e5e-40c1-9de6-b4b585b803a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.219385 Aug 30 00:00:37.957309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 92/167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:37 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:38.978384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:38.978996 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:38.981626 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=83 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:38.986783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:38.987267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:38.987700 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:38.988388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:38.988835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:38.989249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:39.126760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:39.142313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a9606acf-ff60-4660-aaa1-5e5ad731a3f5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.162152 Aug 30 00:00:39.142313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 76/168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:38 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:40.158326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:40.158995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:40.165683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:40.166163 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:40.166630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:40.167320 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:40.167771 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:40.168193 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:40.317564 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:40.325332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1c829f64-dd7a-4f5e-95d2-a960e529190a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.170914 Aug 30 00:00:40.325894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 93/169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:40 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:41.346647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:41.347246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:41.353636 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:41.354112 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:41.354566 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:41.355248 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:41.355691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:41.356685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:41.496926 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:41.510145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dc99b3ee-df4a-4d1a-8fd2-8b1cefda3cb1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.167575 Aug 30 00:00:41.511105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 77/170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:41 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:42.534200 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:42.534823 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:42.542383 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:42.542980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:42.543915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:42.544615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:42.545140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:42.545568 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:42.705951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:42.713681 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b59d78ec-aca8-4979-819c-2dd577916fa7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.183344 Aug 30 00:00:42.714239 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 94/171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:42 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:43.735737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:43.744722 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:43.754262 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:43.754868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:43.758746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:43.760818 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:43.762643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:43.763243 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:43.904841 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:43.912509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0c85f554-6d08-4c01-916e-fa6e19c2034c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.181556 Aug 30 00:00:43.913065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 78/172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:43 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:44.583999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:44.584688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:44.595879 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:44.595879 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:44.596187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:44.598822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:44.606743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:44.606743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:44.633097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:00:44.933216 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:44.934401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:44.945164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:44.945164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:44.945164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:44.945164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:44.945632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:44.945632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:44.995976 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a69ab6b9-1ee5-4347-ae6e-9e0991ed7971 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 204 len: 0 microversion: 2.1 time: 0.414804 Aug 30 00:00:44.997858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 95/173] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:00:44 2022] DELETE /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:00:45.008244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:45.021107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:45.021107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:45.021107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:45.021107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:45.022045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:45.022045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:45.022045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:45.091223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:45.103331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5d22b0b1-39f5-459b-ba62-11969658ee02 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.174036 Aug 30 00:00:45.104637 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 79/174] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:44 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:45.162330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:45.170661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-00c7b849-d34c-4af5-a43e-922784ad49c7 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1553 microversion: 2.1 time: 0.168039 Aug 30 00:00:45.171224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 96/175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:45 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:46.124930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:46.125672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:46.131848 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:46.132329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:46.132767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:46.133453 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:46.133904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:46.134323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:46.191140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:46.191738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:46.198057 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:46.198556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:46.199177 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:46.200582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:46.201040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:46.201461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:46.269644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:46.278284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e9c2a671-80a3-440c-8c9b-11bbf1b462d8 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.156669 Aug 30 00:00:46.278908 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 80/176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:46 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:46.352668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:46.361145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b8e72af9-5877-4a3a-bd1a-427382b4a627 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1553 microversion: 2.1 time: 0.173852 Aug 30 00:00:46.361718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 97/177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:46 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:47.300250 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:47.301037 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:47.307508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:47.308320 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:47.308860 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:47.309680 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:47.310340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:47.311011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:47.383465 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:47.384734 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:47.392176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:47.392662 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:47.393142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:47.393841 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:47.394491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:47.394914 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:47.550953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:47.561407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f2289b76-ebf7-405d-9dfe-03d9a43386cf tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1553 microversion: 2.1 time: 0.181732 Aug 30 00:00:47.563340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 98/178] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:47 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:47.793650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:47.801404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-63542de9-37b1-4aa2-854c-6227a868b8ec tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.505198 Aug 30 00:00:47.801904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 81/179] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:47 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:48.302644 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-6f072e75-076e-4008-a9de-ab79df18d7a9 req-bfa510ba-804b-4017-af78-d331d2ce915c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4298fd8b-9a35-465c-8e05-8d321d59e567", "name": "network-vif-deleted", "tag": "b33c0e15-3bb4-46a9-bcf3-89f592d40e18"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:48.316348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-6f072e75-076e-4008-a9de-ab79df18d7a9 req-bfa510ba-804b-4017-af78-d331d2ce915c service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:48.316859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-6f072e75-076e-4008-a9de-ab79df18d7a9 req-bfa510ba-804b-4017-af78-d331d2ce915c service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:48.317295 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-6f072e75-076e-4008-a9de-ab79df18d7a9 req-bfa510ba-804b-4017-af78-d331d2ce915c service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:48.333532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-6f072e75-076e-4008-a9de-ab79df18d7a9 req-bfa510ba-804b-4017-af78-d331d2ce915c service nova] Creating event network-vif-deleted:b33c0e15-3bb4-46a9-bcf3-89f592d40e18 for instance 4298fd8b-9a35-465c-8e05-8d321d59e567 on hv-cinder-85427 Aug 30 00:00:48.340869 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-6f072e75-076e-4008-a9de-ab79df18d7a9 req-bfa510ba-804b-4017-af78-d331d2ce915c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041782 Aug 30 00:00:48.342754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 99/180] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:48.585284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:48.586043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:48.591952 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:48.592433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:48.592866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:48.593558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:48.594007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:48.594423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:48.623175 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:48.679754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:48.697304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-48659cce-5d26-4128-bfd6-266eda62be45 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1346 microversion: 2.1 time: 0.113331 Aug 30 00:00:48.703449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 82/181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:48 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:48.823560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:48.824264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:48.830193 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:48.830649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:48.831104 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:48.831931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:48.832376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:48.832792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:49.045684 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:49.067275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c0dbd135-5a0e-47bb-9b2f-eff5786f0a01 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.236338 Aug 30 00:00:49.068168 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 100/182] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:48 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:49.731777 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:49.733620 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:49.746385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:49.747207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:49.748385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:49.749512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:49.752160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:49.752160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:49.800804 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:49.801805 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:49.802650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:49.807176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lazy-loading 'fault' on Instance uuid 4298fd8b-9a35-465c-8e05-8d321d59e567 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:00:49.864000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2adc8b5b53b9404d88d88e511e607d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c56e7fb47fb444e993e217411fb4b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:49.871421 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-843e3bd4-22d7-4241-9d25-e58ace3ffa28 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 200 len: 1351 microversion: 2.1 time: 0.146082 Aug 30 00:00:49.871993 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 83/183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:49 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 1351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:50.078967 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:50.079595 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:50.086077 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:50.086611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:50.087031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:50.087721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:50.088165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:50.088759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:50.227186 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:50.240410 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-28bd0ad1-6768-49c9-b97b-f066c481c5fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.165887 Aug 30 00:00:50.243913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 101/184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:50 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:50.893426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:50.894335 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:50.901991 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:50.902957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:50.904325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:50.905882 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:50.907126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:50.908051 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:50.924549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] HTTP exception thrown: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Request method failure captured: Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 HTTP/1.1 Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLxvVSx_Yy6jN8lrA00PQImjm1fT974jfBYB6IpOJO1bzcwp3hp1ja-Ac80E5JOe905QUgTkHrEHXM7vSUWiObEdYRwN8Gd9tMbMPt_ViIr_-CBgGTFTfHEOuTtTRfYKJTxvkLHmoTEpCvtCYz9yZf8jUwzon-vZOJRKH1PRbhibfQ Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:00:50.930208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}] Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 2adc8b5b53b9404d88d88e511e607d1b Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:50.931615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '4298fd8b-9a35-465c-8e05-8d321d59e567'} Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:00:50.932470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:50.934163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:50.936345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Returning 404 to user: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:00:50.937495 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0e5ee956-abe1-48f8-ae4f-32028e060b10 tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 404 len: 111 microversion: 2.1 time: 0.048932 Aug 30 00:00:50.938519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 84/185] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:50 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:00:51.207452 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:51.210085 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:51.217204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:51.217707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:51.218219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:51.218751 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:51.219203 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:51.219619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:51.232843 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] HTTP exception thrown: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Request method failure captured: Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567/os-volume_attachments HTTP/1.1 Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLxvVSx_Yy6jN8lrA00PQImjm1fT974jfBYB6IpOJO1bzcwp3hp1ja-Ac80E5JOe905QUgTkHrEHXM7vSUWiObEdYRwN8Gd9tMbMPt_ViIr_-CBgGTFTfHEOuTtTRfYKJTxvkLHmoTEpCvtCYz9yZf8jUwzon-vZOJRKH1PRbhibfQ Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:00:51.241835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}] Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 2adc8b5b53b9404d88d88e511e607d1b Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:51.243298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'server_id': '4298fd8b-9a35-465c-8e05-8d321d59e567'} Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:00:51.244021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:51.245271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:00:51.246647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Returning 404 to user: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:00:51.246647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0ccd8dbc-8fbb-4a8b-987b-83d2c56be63c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039716 Aug 30 00:00:51.246647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 102/186] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:00:51 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:00:51.265247 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:51.271832 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:51.274540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:51.275089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:51.275580 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:51.276508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:51.276980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:51.277907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:51.425704 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:51.435677 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-76091c4a-e51b-4d9d-b6c9-57941862df4c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.174545 Aug 30 00:00:51.436586 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 85/187] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:51 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:52.458959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:52.460535 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:52.469614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:52.470330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:52.471368 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:52.472798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:52.473769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:52.474827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:52.618365 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:52.625408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:52.626737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:52.627334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:52.627865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:52.628798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:52.629743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:52.630394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:52.651829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:52.661845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-32345be2-3bbb-4030-bfcb-276270bcecb4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.207954 Aug 30 00:00:52.662826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] HTTP exception thrown: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Request method failure captured: Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 HTTP/1.1 Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLxvVSx_Yy6jN8lrA00PQImjm1fT974jfBYB6IpOJO1bzcwp3hp1ja-Ac80E5JOe905QUgTkHrEHXM7vSUWiObEdYRwN8Gd9tMbMPt_ViIr_-CBgGTFTfHEOuTtTRfYKJTxvkLHmoTEpCvtCYz9yZf8jUwzon-vZOJRKH1PRbhibfQ Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:00:52.664663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}] Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 2adc8b5b53b9404d88d88e511e607d1b Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.665894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '4298fd8b-9a35-465c-8e05-8d321d59e567'} Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:00:52.666937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.674406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.675950 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Returning 404 to user: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:00:52.675950 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f07fd9ab-1582-4c51-8f9b-1f7b10ed515c tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 404 len: 111 microversion: 2.1 time: 0.056092 Aug 30 00:00:52.676660 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 86/189] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:00:52 2022] DELETE /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:00:52.676896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 103/189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:52 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:52.682340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:52.683124 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] [instance: 4298fd8b-9a35-465c-8e05-8d321d59e567] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:52.690005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:52.690650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:52.691182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:52.691995 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:52.692632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:52.693054 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:52.707143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] HTTP exception thrown: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Request method failure captured: Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 HTTP/1.1 Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLxvVSx_Yy6jN8lrA00PQImjm1fT974jfBYB6IpOJO1bzcwp3hp1ja-Ac80E5JOe905QUgTkHrEHXM7vSUWiObEdYRwN8Gd9tMbMPt_ViIr_-CBgGTFTfHEOuTtTRfYKJTxvkLHmoTEpCvtCYz9yZf8jUwzon-vZOJRKH1PRbhibfQ Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:00:52.709369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c56e7fb47fb444e993e217411fb4b50"}]}] Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 4c56e7fb47fb444e993e217411fb4b50 Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-DeleteServersTestJSON-929932128 Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 2adc8b5b53b9404d88d88e511e607d1b Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-DeleteServersTestJSON-929932128-project Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.710869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '4298fd8b-9a35-465c-8e05-8d321d59e567'} Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:00:52.711707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. Aug 30 00:00:52.713207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:00:52.715246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] Returning 404 to user: Instance 4298fd8b-9a35-465c-8e05-8d321d59e567 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:00:52.715246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8b9a2c1d-538a-45c8-aef9-ba8f314a7b5f tempest-DeleteServersTestJSON-929932128 tempest-DeleteServersTestJSON-929932128-project] 10.222.0.60 "GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567" status: 404 len: 111 microversion: 2.1 time: 0.032752 Aug 30 00:00:52.715610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 87/190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:52 2022] GET /compute/v2.1/servers/4298fd8b-9a35-465c-8e05-8d321d59e567 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:00:53.685704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:53.686986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:53.695864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:53.696604 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:53.698351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:53.726986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:53.728991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:53.729655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:53.748755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:53.981824 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:53.989812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1083a150-f1f3-458a-918f-f1498cad64d7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.307983 Aug 30 00:00:53.990670 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 104/191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:53 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:55.015458 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:55.017256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:55.025649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:55.026131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:55.028354 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:55.029067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:55.029520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:55.030315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:55.192314 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:55.200826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0531ffb5-6ef9-40d5-a8ed-0cb0d25e06de tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.192856 Aug 30 00:00:55.201517 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 88/192] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:55 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:55.791037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-954123669", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "networks": [{"uuid": "247e5d21-8dc4-4240-b9bb-9589e80f58e5"}]}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:55.852421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] validate_networks() for [('247e5d21-8dc4-4240-b9bb-9589e80f58e5', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:00:56.221557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:56.222283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:56.229430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:56.230005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:56.230483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:56.231361 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:56.231806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:56.232213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:56.305508 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:00:56.306151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:00:56.306865 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:00:56.307430 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:00:56.308849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:00:56.313346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:56.323276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:56.326680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:56.328341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:56.330059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:56.330562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:56.333782 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:56.369933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Getting quotas for project 0619f86cdbc8483d870cd5ac288312e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:00:56.380866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Getting quotas for user 01bff0f027d44af4a9f6aeeafa16c27d and project 0619f86cdbc8483d870cd5ac288312e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:00:56.398809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:00:56.401806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:00:56.523892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:56.556031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9ede5dc8-6d10-4d74-b370-17d94e608014 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.338107 Aug 30 00:00:56.564714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 89/193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:56 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:56.582791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f48a3698-6a58-49e1-8bb5-52f8d346776a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793929 Aug 30 00:00:56.584421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 105/194] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:00:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:00:56.601333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-de4b322c-d17d-4345-9f35-e00ee67970d4 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:56.601999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-de4b322c-d17d-4345-9f35-e00ee67970d4 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:56.773908 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-de4b322c-d17d-4345-9f35-e00ee67970d4 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:56.786886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-de4b322c-d17d-4345-9f35-e00ee67970d4 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1213 microversion: 2.1 time: 0.189323 Aug 30 00:00:56.794259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 90/195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:56 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1213 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:57.592856 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:57.594775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:57.624880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:57.624880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:57.624880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:57.624880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:57.625363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:57.625726 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:57.814358 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2c9cf129-904c-45c5-8179-f3f00f311d45 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:57.815164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2c9cf129-904c-45c5-8179-f3f00f311d45 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:57.875826 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:57.884567 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-93f00c3c-acb3-498b-8195-e85f4055b359 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.300035 Aug 30 00:00:57.889149 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 106/196] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:57 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:57.925715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2c9cf129-904c-45c5-8179-f3f00f311d45 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:57.935664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2c9cf129-904c-45c5-8179-f3f00f311d45 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1213 microversion: 2.1 time: 0.125891 Aug 30 00:00:57.936246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 91/197] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:57 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:58.915035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:58.915749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:58.923901 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:58.924471 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:58.925020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:58.925781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:58.926326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:58.926842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:58.957116 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:58.957742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:58.964117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:58.964575 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:58.964977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:58.965673 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:58.966125 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:58.966599 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:59.048644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:59.059451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7ce6528e-1105-44bc-add9-98680d81645e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1265 microversion: 2.1 time: 0.105086 Aug 30 00:00:59.071258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 92/198] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:58 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:59.080590 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:59.095764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c62f31fd-6e8a-4448-9f85-1a7814bbb1bf tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.184505 Aug 30 00:00:59.096351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 107/199] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:58 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:00.085273 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:00.086806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:00.095501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:00.096398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:00.096996 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:00.098384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:00.099280 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:00.101053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:00.119244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:00.120664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:00.129762 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:00.130652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:00.131326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:00.132980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:00.134220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:00.135233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:00.213279 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:00.224795 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-def34f68-7eb9-4ae1-9fea-b38f3e9e0357 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1271 microversion: 2.1 time: 0.145376 Aug 30 00:01:00.225851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 93/200] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:00 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:00.329518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:00.338199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9d0ae2aa-a517-4dfd-a27d-888e00a7c0a4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.224746 Aug 30 00:01:00.338868 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 108/201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:00 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:01.249909 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:01.250533 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:01.258296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:01.259411 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:01.260277 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:01.261535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:01.262561 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:01.263352 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:01.360512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:01.361116 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:01.367572 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:01.368049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:01.368832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:01.369244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:01.369692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:01.370113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:01.500711 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:01.508733 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5d582eb0-5da6-46e2-b9db-35aa0b7d9066 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1313 microversion: 2.1 time: 0.263317 Aug 30 00:01:01.509308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 94/202] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:01 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:01.563566 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:01.573274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-71e78023-45f3-4ab4-8b69-97a676788d93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.216538 Aug 30 00:01:01.589486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 109/203] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:01 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:01.654099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-17036852-97df-4a0f-96b9-07e37fe49675 req-865590be-37ee-4c85-bf55-06e53febfa96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d822e8a-130b-4bba-841c-ac40afbdde90", "tag": "625f7b3b-4a22-41d3-90ee-28eae69737be"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:01.664374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-17036852-97df-4a0f-96b9-07e37fe49675 req-865590be-37ee-4c85-bf55-06e53febfa96 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:01.664374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-17036852-97df-4a0f-96b9-07e37fe49675 req-865590be-37ee-4c85-bf55-06e53febfa96 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:01.664793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-17036852-97df-4a0f-96b9-07e37fe49675 req-865590be-37ee-4c85-bf55-06e53febfa96 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:01.676787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-17036852-97df-4a0f-96b9-07e37fe49675 req-865590be-37ee-4c85-bf55-06e53febfa96 service nova] Creating event network-changed:625f7b3b-4a22-41d3-90ee-28eae69737be for instance 1d822e8a-130b-4bba-841c-ac40afbdde90 on hv-cinder-85427 Aug 30 00:01:01.685536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-17036852-97df-4a0f-96b9-07e37fe49675 req-865590be-37ee-4c85-bf55-06e53febfa96 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035416 Aug 30 00:01:01.686299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 95/204] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:02.533117 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:02.533733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:02.544828 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.545997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.546812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.547894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.548562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.548992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.597919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:02.598674 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:02.608078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.610790 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.611246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.615194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.615848 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.616720 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.810447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:02.825089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2c64df36-1885-4e74-b4a4-2cc7e4ab1bde tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.232012 Aug 30 00:01:02.828641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 96/205] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:02 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:03.160364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:03.171203 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-af2a2c85-99e6-4f91-bf38-df3bef8feeb2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1313 microversion: 2.1 time: 0.642635 Aug 30 00:01:03.171929 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 110/206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:02 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:03.857338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:03.858167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:03.865746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:03.866564 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:03.867001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:03.867719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:03.868390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:03.868821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:04.026342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:04.041200 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fdb750a3-0b59-483e-a99d-37fdebb2e07f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.189983 Aug 30 00:01:04.052073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 97/207] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:03 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:04.200667 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:04.205926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:04.225589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:04.226774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:04.228772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:04.229728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:04.231806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:04.235243 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:04.391475 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:04.400750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f62ac23f-e0f7-4d5f-91f7-897da762f28f tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1313 microversion: 2.1 time: 0.207952 Aug 30 00:01:04.402647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 111/208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:04 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:05.072328 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:05.073233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:05.093810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.094787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.095609 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.099596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.100440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.103062 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.405028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:05.414343 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dd66cc52-654e-44e2-adf9-bf3f1504ebad tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.348130 Aug 30 00:01:05.416428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 98/209] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:05 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:05.425755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:05.431279 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:05.433786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.440560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.446527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.447679 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.448427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.449058 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.699921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:05.704935 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-693c8c53-deb5-4963-9aca-efb11b853f14 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1313 microversion: 2.1 time: 0.287477 Aug 30 00:01:05.705518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 112/210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:05 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:06.442105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:06.443381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:06.456296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:06.457050 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:06.457826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:06.459020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:06.459402 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:06.459990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:06.728424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:06.729263 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:06.764598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:06.771748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=6 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:06.781922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:06.782456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:06.784091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:06.785036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:06.787431 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:06.787988 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:06.803581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:06.817614 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-39f5f511-1bdf-4ae4-849d-1c2bf6709fa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1522 microversion: 2.1 time: 0.380052 Aug 30 00:01:06.819828 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 99/211] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:06 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:06.834636 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-af40f721-5359-4bfa-b703-eb4003fe9ca6 req-1b6e5672-682f-4a9e-8fd7-5fb7ab9481d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d822e8a-130b-4bba-841c-ac40afbdde90", "name": "network-vif-plugged", "status": "completed", "tag": "625f7b3b-4a22-41d3-90ee-28eae69737be"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:06.853876 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-af40f721-5359-4bfa-b703-eb4003fe9ca6 req-1b6e5672-682f-4a9e-8fd7-5fb7ab9481d0 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:06.855278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-af40f721-5359-4bfa-b703-eb4003fe9ca6 req-1b6e5672-682f-4a9e-8fd7-5fb7ab9481d0 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:06.855864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-af40f721-5359-4bfa-b703-eb4003fe9ca6 req-1b6e5672-682f-4a9e-8fd7-5fb7ab9481d0 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:06.872617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-af40f721-5359-4bfa-b703-eb4003fe9ca6 req-1b6e5672-682f-4a9e-8fd7-5fb7ab9481d0 service nova] Creating event network-vif-plugged:625f7b3b-4a22-41d3-90ee-28eae69737be for instance 1d822e8a-130b-4bba-841c-ac40afbdde90 on hv-cinder-85427 Aug 30 00:01:06.885316 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-af40f721-5359-4bfa-b703-eb4003fe9ca6 req-1b6e5672-682f-4a9e-8fd7-5fb7ab9481d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062627 Aug 30 00:01:06.887714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 100/212] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:07.227362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:07.236097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e7104608-07a9-491e-a62a-2b59f24cbb80 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1313 microversion: 2.1 time: 0.513437 Aug 30 00:01:07.236799 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 113/213] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:06 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:07.664888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-41ebc45e-8fbe-421c-a031-9b2d0fbac2e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: .version_select at 0x7f09bf3e41f0>, body: {"keypair": {"name": "tempest-keypair-2088556371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjYfZx8ei1nFpszfk1LzWsd9MH2cZZrLj+/AMtwy+1lq0G19ZJJzVGmz6CPYSk8dpMugV8FfC3msRG1aWixMjQTaZMxfUQbBIa8mFuCLa/aMPQ5HpS0A359PXfvAi54BQ=="}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:07.690925 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-41ebc45e-8fbe-421c-a031-9b2d0fbac2e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:07.699429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-41ebc45e-8fbe-421c-a031-9b2d0fbac2e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:07.824060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-41ebc45e-8fbe-421c-a031-9b2d0fbac2e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.409308 Aug 30 00:01:07.825658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 101/214] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:01:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:07.852296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:07.853430 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:07.861485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:07.862155 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:07.862941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:07.863703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:07.864403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:07.865001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.076535 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:08.087953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-05fbd85e-7ec5-422d-93be-5c147333ff8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1502 microversion: 2.1 time: 0.245682 Aug 30 00:01:08.088551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 114/215] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:07 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:08.117032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:08.118451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:08.127256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.127891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.128398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.129265 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.129794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.130299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.260653 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:08.262533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:08.272705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.273299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.273807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.274619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.275303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.275785 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.447859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:08.469702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7ed2bafd-524d-4072-9da2-04f484fcb3e4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1515 microversion: 2.1 time: 0.360662 Aug 30 00:01:08.483204 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 102/216] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:08 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:08.545971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:08.561363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6d65fa9d-5c71-47d1-9f2f-52b131e02dd9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1313 microversion: 2.1 time: 0.307560 Aug 30 00:01:08.561959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 115/217] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:08 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:09.586259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:09.587526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:09.602369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.609986 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.610450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.613127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.613965 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.615871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.856930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:09.876433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9c683d71-9fbe-4639-86ea-9efac2c18811 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1498 microversion: 2.1 time: 0.286727 Aug 30 00:01:09.876433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 103/218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:09 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1498 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:10.396136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:10.399324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:10.407356 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.408052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.408648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.412925 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.412925 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.412925 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.440188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lazy-loading 'flavor' on Instance uuid 3df5b062-9099-42fa-9bcc-40d56163ce2b {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:10.798281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-532850ef-e0dd-4126-b804-a8e92258e736 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b/action" status: 200 len: 32 microversion: 2.1 time: 0.405978 Aug 30 00:01:10.802817 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 116/219] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:01:10 2022] POST /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:01:10.803355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1275810415", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb60052-2932-481b-a354-8ea27a27493d"}], "security_groups": [{"name": "tempest-securitygroup--1523622753"}], "key_name": "tempest-keypair-2088556371", "user_data": "}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:10.812720 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:10.813751 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:10.825852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.828090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.832291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.832291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.832291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.832291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.975219 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] validate_networks() for [('ffb60052-2932-481b-a354-8ea27a27493d', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:01:11.055963 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:11.065555 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-26e36801-2865-4baf-9504-df4fc35624e9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.257869 Aug 30 00:01:11.066717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 117/220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:10 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:11.117104 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-52450133", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:11.192522 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] validate_networks() for None {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:01:11.372219 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:11.779743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:01:11.780464 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:01:11.780645 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:01:11.781188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:01:11.781803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:01:11.792589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.792996 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.793432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:11.794150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.794635 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.795240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:11.814362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Getting quotas for project f87f87f955d84a668c6d75a232b3be81. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:11.819229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Getting quotas for user eedc3c6fa04140af90274a11fe46a51a and project f87f87f955d84a668c6d75a232b3be81. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:11.832589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:01:11.834929 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:01:12.033028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aaa55468-5a30-47cf-9d44-6131d78d65ba tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919827 Aug 30 00:01:12.033924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 118/221] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:01:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:01:12.040379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:12.041145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:12.051101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.052024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.052718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.053728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.054420 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.055083 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.060771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:01:12.061997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:01:12.062902 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:01:12.063536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:01:12.064189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:01:12.086748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.087237 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.087704 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.088421 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.088906 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.089330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.144961 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:01:12.152951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:12.169865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:12.191591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:01:12.195072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:01:12.239789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:12.378301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2834dea1-b619-467c-8717-e794e2574452 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.582964 Aug 30 00:01:12.379004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 104/222] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:01:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 00:01:12.383530 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9c03357d-b2e0-48a9-ad42-cd22f13f0447 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:12.384132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9c03357d-b2e0-48a9-ad42-cd22f13f0447 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:12.437867 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9c03357d-b2e0-48a9-ad42-cd22f13f0447 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:12.446506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9c03357d-b2e0-48a9-ad42-cd22f13f0447 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1213 microversion: 2.1 time: 0.066505 Aug 30 00:01:12.455115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 105/223] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:12 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:12.468053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:12.468826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:12.487874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.488857 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.490551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.494385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.496085 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.496760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.600125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4652d465-dfd4-41b0-8193-ec5fd2c243ea tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 204 len: 0 microversion: 2.1 time: 0.562090 Aug 30 00:01:12.601269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 119/224] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:01:12 2022] DELETE /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:12.611847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a9e9789c-fefe-486f-adb0-a1ab02937ba1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:12.612407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a9e9789c-fefe-486f-adb0-a1ab02937ba1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:12.729294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a9e9789c-fefe-486f-adb0-a1ab02937ba1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:12.740727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a9e9789c-fefe-486f-adb0-a1ab02937ba1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1242 microversion: 2.1 time: 0.136376 Aug 30 00:01:12.741286 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 120/225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:12 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:12.744482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:12.746490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:12.747096 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:12.749408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:12.752790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.753423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.754001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.754969 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.755683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.756247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.759183 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9a8c849e-a9e3-4dbd-9f4d-63532210ae5c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.306815 Aug 30 00:01:12.760188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 106/226] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:12 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:13.095056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:13.112125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8ca0f064-5116-4c08-b761-296b2969e7a9 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1504 microversion: 2.1 time: 0.368722 Aug 30 00:01:13.113423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 121/227] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:12 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:13.486230 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:13.490919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:13.493183 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.493664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.494093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.495047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.495499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.495918 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.575850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:13.584547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6845724a-8ba7-4640-8a08-01186698b44d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1217 microversion: 2.1 time: 0.102453 Aug 30 00:01:13.585341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 107/228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:13 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:13.761850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:13.762457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:13.769391 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.769867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.770294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.771195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.771524 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.772254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.784878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:13.785489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:13.792476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.793207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.793646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.794373 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.796090 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.799841 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.847207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:13.857486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3004c05c-3c65-4319-ac04-a7d51ce635fa tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1246 microversion: 2.1 time: 0.100132 Aug 30 00:01:13.858074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 122/229] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:13 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:13.942450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:13.954623 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d0b515c0-953c-4b1b-b137-6ad7e603c782 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.173723 Aug 30 00:01:13.955407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 108/230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:13 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:14.137578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:14.138200 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:14.145442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.146971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.146971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.146971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.147562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.147989 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.298072 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:14.306230 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e68d3c3f-c3e4-49cd-ab87-e592b7fee164 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1504 microversion: 2.1 time: 0.175532 Aug 30 00:01:14.306845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 123/231] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:14 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:14.606038 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:14.606774 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:14.612795 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.613262 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.613907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.614619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.615318 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.615753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.704211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:14.712520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-09bc1257-6a7c-4cb0-a8db-f53842b40f10 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1265 microversion: 2.1 time: 0.110291 Aug 30 00:01:14.717468 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 109/232] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:14 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:14.883812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:14.887587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:14.900386 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.902828 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.903383 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.904219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.906912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.907454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.985101 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:14.985101 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:14.986746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.987258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.987699 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.988430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.989026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.989666 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.005550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:15.015889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2e688656-1684-413d-addd-dd7a5e1a1528 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1294 microversion: 2.1 time: 0.141179 Aug 30 00:01:15.030603 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 124/233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:14 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:15.144908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-c62890b0-0e67-4b99-a8dc-71d52a7d47d5 req-47dd6f9f-c506-4a0d-942b-b9779120e4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d822e8a-130b-4bba-841c-ac40afbdde90", "name": "network-vif-deleted", "tag": "625f7b3b-4a22-41d3-90ee-28eae69737be"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:15.155189 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-c62890b0-0e67-4b99-a8dc-71d52a7d47d5 req-47dd6f9f-c506-4a0d-942b-b9779120e4b6 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.155664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-c62890b0-0e67-4b99-a8dc-71d52a7d47d5 req-47dd6f9f-c506-4a0d-942b-b9779120e4b6 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.156093 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-c62890b0-0e67-4b99-a8dc-71d52a7d47d5 req-47dd6f9f-c506-4a0d-942b-b9779120e4b6 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.167698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-c62890b0-0e67-4b99-a8dc-71d52a7d47d5 req-47dd6f9f-c506-4a0d-942b-b9779120e4b6 service nova] Creating event network-vif-deleted:625f7b3b-4a22-41d3-90ee-28eae69737be for instance 1d822e8a-130b-4bba-841c-ac40afbdde90 on hv-cinder-85427 Aug 30 00:01:15.173010 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-c62890b0-0e67-4b99-a8dc-71d52a7d47d5 req-47dd6f9f-c506-4a0d-942b-b9779120e4b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031846 Aug 30 00:01:15.173602 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 125/234] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:01:15.194192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:15.203537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b493ce2a-3ed6-4673-98d5-4e01d81cd068 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.228105 Aug 30 00:01:15.204129 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 110/235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:14 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:15.328156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:15.328850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:15.335319 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.335801 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.336235 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.336919 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.337370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.337792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.411394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:15.414326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-698beefb-1a16-4b58-aea5-2a5a2342b9fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1462 microversion: 2.1 time: 0.090213 Aug 30 00:01:15.414709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 126/236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:15 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:15.738641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:15.739243 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:15.746052 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.746549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.746977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.747648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.748100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.748509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.810903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:15.819310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-86e913e9-320a-4ebf-ad11-6990652ce7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1273 microversion: 2.1 time: 0.084511 Aug 30 00:01:15.819954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 111/237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:15 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:16.036959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:16.042267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:16.048776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.049675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.050905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.051961 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.052840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.053266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.130822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:16.143076 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-37b78950-bcc9-4bbb-aaea-30e5a064bbc3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1302 microversion: 2.1 time: 0.106060 Aug 30 00:01:16.145485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 127/238] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:16 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1302 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:16.225513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:16.226140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:16.234732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.237160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.237720 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.238441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.238926 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.239355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.436030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:16.436859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:16.443428 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.444291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.444949 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.445761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.446332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.447099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.459841 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:16.468637 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5a1a6bd5-673c-4fcb-b3f5-265ea9d95514 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.247222 Aug 30 00:01:16.469313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 112/239] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:16 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:16.485030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.485030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.485030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.485030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lazy-loading 'fault' on Instance uuid 1d822e8a-130b-4bba-841c-ac40afbdde90 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:16.530799 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:16.563497 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f777813f-d891-4567-b772-464a3c5a3824 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 200 len: 1303 microversion: 2.1 time: 0.131032 Aug 30 00:01:16.564509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 128/240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:16 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:16.799024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:16.799522 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:16.810691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.811181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.811625 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.820011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.820553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.820993 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.845697 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:16.846678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:16.853612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d872edc2-04fd-43d4-bc3c-04f387ab3bc9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/ips" status: 200 len: 151 microversion: 2.20 time: 0.064388 Aug 30 00:01:16.855274 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 113/241] 10.222.0.60 () {60 vars in 1289 bytes} [Tue Aug 30 00:01:16 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:01:16.867557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.868081 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.868630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.869499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.871351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.871992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.952881 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:16.961899 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c6d75f4c-a664-44db-982a-2aadca765475 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1271 microversion: 2.1 time: 0.121078 Aug 30 00:01:16.963552 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 129/242] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:16 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:17.164618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:17.165479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:17.172307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.173109 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.173531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.174271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.174833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.175250 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.288996 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:17.296708 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-60c18c42-7dc4-4cda-9f5f-8b94e13c5374 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1300 microversion: 2.1 time: 0.136227 Aug 30 00:01:17.297283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 114/243] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:17 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:17.490560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:17.491165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:17.498410 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.498931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.499346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.500057 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.500486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.500905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.586015 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:17.587203 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 1d822e8a-130b-4bba-841c-ac40afbdde90] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:17.598670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.600299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.602506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.603437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.606424 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.607077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.631784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] HTTP exception thrown: Instance 1d822e8a-130b-4bba-841c-ac40afbdde90 could not be found. Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Request method failure captured: Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 HTTP/1.1 Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVM1UUrm026RnlBUnvi1J3HfF4UXT1dnv864JVVs_VPEp0994sOkKAHHYK1SS0a5rSYLtGHxblwYe_q848ej3qcxFMOkdd-0ujAbru6cgun_MCQqtb6qyTl5l9NDwGcCS1yo4VT7hvVNbpg-CFMusxFyJPNWkVuCuUWTD04_fij9ixk Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 0619f86cdbc8483d870cd5ac288312e6 Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesActionsTest-965781585 Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:01:17.633598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0619f86cdbc8483d870cd5ac288312e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0619f86cdbc8483d870cd5ac288312e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0619f86cdbc8483d870cd5ac288312e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0619f86cdbc8483d870cd5ac288312e6"}]}] Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesActionsTest-965781585 Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 0619f86cdbc8483d870cd5ac288312e6 Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesActionsTest-965781585 Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesActionsTest-965781585-project Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 01bff0f027d44af4a9f6aeeafa16c27d Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesActionsTest-965781585-project Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 1d822e8a-130b-4bba-841c-ac40afbdde90 could not be found. Aug 30 00:01:17.635787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '1d822e8a-130b-4bba-841c-ac40afbdde90'} Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d822e8a-130b-4bba-841c-ac40afbdde90 could not be found. Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:01:17.636946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d822e8a-130b-4bba-841c-ac40afbdde90 could not be found. Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d822e8a-130b-4bba-841c-ac40afbdde90 could not be found. Aug 30 00:01:17.638341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:17.640179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Returning 404 to user: Instance 1d822e8a-130b-4bba-841c-ac40afbdde90 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:01:17.640179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cec2e2ac-e631-461c-9657-09550ab26293 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90" status: 404 len: 111 microversion: 2.1 time: 0.053106 Aug 30 00:01:17.642813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 115/244] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:17 2022] GET /compute/v2.1/servers/1d822e8a-130b-4bba-841c-ac40afbdde90 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:01:17.692382 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:17.704274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-200fc571-57a6-48ab-b3ce-f228a0ad2cc5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.214467 Aug 30 00:01:17.704274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 130/245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:17 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:17.807345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1373628147", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "networks": [{"uuid": "247e5d21-8dc4-4240-b9bb-9589e80f58e5"}]}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:17.871272 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] validate_networks() for [('247e5d21-8dc4-4240-b9bb-9589e80f58e5', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:01:17.983919 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:17.984532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:17.990547 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.991035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.991464 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.992167 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:17.992797 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:17.993224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:18.158247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:18.167661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ceb124d1-c20b-45a0-8fa1-e88f43f14025 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.186956 Aug 30 00:01:18.168183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 131/246] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:17 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:18.325227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:18.326114 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:18.332630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:18.333228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:18.333710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:18.334366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:18.335004 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:18.335431 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:18.474429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:18.482657 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1ac02b13-43e8-4e9a-a3fc-448e5b7d5250 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.169169 Aug 30 00:01:18.483236 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 132/247] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:18 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:18.724351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:18.725555 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:18.732158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:18.732718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:18.733220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:18.733979 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:18.734513 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:18.735002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:18.867912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:18.876963 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dde0f5d2-754c-4468-8b1f-d10b6689e265 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.156621 Aug 30 00:01:18.877532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 133/248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:18 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:19.033923 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:01:19.034509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:01:19.034822 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:01:19.035221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:01:19.035619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:01:19.045263 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.045740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.046184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.046909 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.048082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.048082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.066656 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Getting quotas for project 0619f86cdbc8483d870cd5ac288312e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:19.071181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Getting quotas for user 01bff0f027d44af4a9f6aeeafa16c27d and project 0619f86cdbc8483d870cd5ac288312e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:19.082719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:01:19.084988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:01:19.189615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:19.189615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:19.194598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.195271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.195931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.196981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.198176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.199006 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.212388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7b6b0311-63a7-4577-a51d-b9cc6366ce09 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408952 Aug 30 00:01:19.219859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 116/249] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:01:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:01:19.227225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-360e264d-b0b5-42c7-a565-e0c6b4ac79e2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:19.228064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-360e264d-b0b5-42c7-a565-e0c6b4ac79e2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:19.319147 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-360e264d-b0b5-42c7-a565-e0c6b4ac79e2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:19.347380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-360e264d-b0b5-42c7-a565-e0c6b4ac79e2 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1214 microversion: 2.1 time: 0.124985 Aug 30 00:01:19.347969 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 117/250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:19 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:19.356282 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:19.364128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2db11c8f-059e-42e2-a902-6eb838015d2c tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.179661 Aug 30 00:01:19.367956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 134/251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:19 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:19.503165 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:19.503871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:19.511776 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.512256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.512682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.513369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.513814 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.514231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.621864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-4913c83f-f4ca-4b72-b29a-7f93f0f044fa req-7daa2405-34c2-4086-b141-daf086661c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0e6e6d-8147-432e-bb65-a51972dcc8c6", "tag": "6d8b21ec-d874-4517-9c4d-31c0a7bad3ec"}, {"name": "network-changed", "server_uuid": "a9105900-32ff-4338-bffd-cdf09407a6a6", "tag": "2e3fc215-ce48-4169-86c0-77d59d94c4ab"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:19.633966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-4913c83f-f4ca-4b72-b29a-7f93f0f044fa req-7daa2405-34c2-4086-b141-daf086661c97 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.634506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-4913c83f-f4ca-4b72-b29a-7f93f0f044fa req-7daa2405-34c2-4086-b141-daf086661c97 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.635215 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-4913c83f-f4ca-4b72-b29a-7f93f0f044fa req-7daa2405-34c2-4086-b141-daf086661c97 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.650138 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-4913c83f-f4ca-4b72-b29a-7f93f0f044fa req-7daa2405-34c2-4086-b141-daf086661c97 service nova] Creating event network-changed:6d8b21ec-d874-4517-9c4d-31c0a7bad3ec for instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 on hv-cinder-85427 Aug 30 00:01:19.650686 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-4913c83f-f4ca-4b72-b29a-7f93f0f044fa req-7daa2405-34c2-4086-b141-daf086661c97 service nova] Creating event network-changed:2e3fc215-ce48-4169-86c0-77d59d94c4ab for instance a9105900-32ff-4338-bffd-cdf09407a6a6 on hv-cinder-85427 Aug 30 00:01:19.657670 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-4913c83f-f4ca-4b72-b29a-7f93f0f044fa req-7daa2405-34c2-4086-b141-daf086661c97 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041670 Aug 30 00:01:19.658812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 135/252] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:19.794312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:19.805114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5199bc8f-418f-40ea-8f21-a0d7da20eb31 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.305823 Aug 30 00:01:19.814715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 118/253] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:19 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:19.912856 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:19.915840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:19.936147 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.937390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.940758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.942852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.943804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.944887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.143388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:20.153591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-72e7795b-8256-49b3-991d-2b4349c95276 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.256536 Aug 30 00:01:20.154439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 136/254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:19 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:20.371846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:20.372779 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:20.379878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.380594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.381188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.382042 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.382521 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.382924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.396455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:20.397077 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:20.400857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:20.409816 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.413506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.413506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.413506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.413506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.414269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.421418 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:20.497861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:20.516098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c9cb687e-76e5-41a8-b1e2-db26b0aa930a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1218 microversion: 2.1 time: 0.151268 Aug 30 00:01:20.517143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 119/255] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:20 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:20.522283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:20.522855 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:20.528949 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.530915 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.531528 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.532407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.535898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.535898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.566316 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lazy-loading 'flavor' on Instance uuid bfa3cd3e-c701-4851-a613-4c89ea690072 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:20.609625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:20.619026 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-29ef827f-c379-4eba-84de-f1be8f6c5cc8 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.227218 Aug 30 00:01:20.620661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 137/256] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:20 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:20.826940 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:20.827526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:20.834703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.835189 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.835626 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.843272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.843823 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.844327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.982968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3d41f6ae-e2fb-449f-b52e-53ef3fff1a51 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/action" status: 202 len: 0 microversion: 2.20 time: 0.464317 Aug 30 00:01:20.986810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 120/257] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 30 00:01:20 2022] POST /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:20.990071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:20.993696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:20.993921 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:21.000393 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.001115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.001237 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b5d39843-0f8c-4a3e-ac22-7ecbb1c1bf2f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.178781 Aug 30 00:01:21.001481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.001696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 138/258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:20 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:21.002179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.002710 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.003137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.151310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:21.159751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:21.161180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:21.162461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f0f8a73c-6cc5-4bbc-97de-1550e7d36c81 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.174294 Aug 30 00:01:21.163049 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 121/259] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:20 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:21.175313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:21.176153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:21.182240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.182753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.183192 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.183886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.184343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.184769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.321785 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:21.329999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-53bfce3a-d526-4f5d-8321-7a5bcf9c6a39 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.158539 Aug 30 00:01:21.331931 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 139/260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:21 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:21.536417 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:21.537026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:21.543816 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.544292 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.544727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.545422 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.545872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.546313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.610022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:21.614649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8e0c482e-957c-4263-9ddf-a7445af43d59 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1210 microversion: 2.1 time: 0.081991 Aug 30 00:01:21.615282 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 122/261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:21 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:21.641916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:21.642908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:21.649601 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.649856 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.651316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.652253 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.653010 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.654079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.801423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:21.803649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:21.810451 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e23300b6-2776-49e7-8a15-f128c2ba90fd tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.172756 Aug 30 00:01:21.812041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 140/262] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:21 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:22.022990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:22.023526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:22.029436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.029917 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.030348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.031138 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.031590 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.032009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.167635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:22.176243 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3d1726be-b14d-4913-9f0a-4bf2cad9809d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.157354 Aug 30 00:01:22.176895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 123/263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:22 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:22.187462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:22.188074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:22.194548 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.195066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.195502 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.196260 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.196718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.197147 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.334435 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:22.342561 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:22.344011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:22.345144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a011dc34-6681-42a1-bdeb-716cdddea71b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.162158 Aug 30 00:01:22.345999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 141/264] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:22 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:22.353202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:22.354362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:22.360321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.360794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.361224 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.361900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.362348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.362790 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.366951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:22.498993 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:22.506441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e538db4b-1fb7-4001-924d-861580382798 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.157591 Aug 30 00:01:22.507035 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 124/265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:22 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:22.636866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:22.637472 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:22.643456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.643957 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.644366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.645043 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.645496 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.646023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.707796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:22.716000 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-82ec40c4-bf98-4529-b0fe-085f87dfa8bc tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1266 microversion: 2.1 time: 0.083405 Aug 30 00:01:22.716557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 142/266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:22 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:22.833677 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:22.834218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:22.841356 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.841830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.842253 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.842952 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.843395 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.843804 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.970440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:22.977930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-98b9bb51-8d03-44c8-b7da-9b2b8108c321 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.148543 Aug 30 00:01:22.978595 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 125/267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:22 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:23.202926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:23.203537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:23.205364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=8 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:23.210596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.211088 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.211549 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.212243 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.212693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.213617 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.349640 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:23.357924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-632f5833-f70a-490a-b534-4b40306fa08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.158791 Aug 30 00:01:23.358530 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 143/268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:23 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:23.368298 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:23.368890 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:23.375020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.375486 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.375995 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.376678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.377117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.377528 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.516482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:23.524521 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:23.526584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:23.527732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-11b60cb6-62b9-45f7-b1cd-c9624eb9a68a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.163596 Aug 30 00:01:23.528286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 126/269] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:23 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:23.528704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:23.529318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:23.535325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.535809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.536243 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.536932 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.537386 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.537810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.664442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:23.672173 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2f6304c6-5999-44db-8eae-41e150caa6f1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.148147 Aug 30 00:01:23.672746 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 144/270] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:23 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:23.738457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:23.739004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:23.745010 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.745482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.745911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.746619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:23.747068 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:23.747481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.809828 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:23.817354 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bbcd65f3-3440-4fdd-acd0-2a6be377eb17 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1266 microversion: 2.1 time: 0.083445 Aug 30 00:01:23.817916 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 127/271] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:23 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:23.999233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:23.999755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:24.006271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.006798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.007256 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.007958 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.008408 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.008829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.142626 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.150105 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4cabcebc-f6c7-4f0a-be7e-e2e8daf6682d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.155485 Aug 30 00:01:24.151207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 145/272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:23 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:24.378708 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:24.379308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:24.385214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.385702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.386399 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.387238 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.387685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.388102 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.514168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.522045 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-904897b2-9c43-4e13-863f-42818715b0a3 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.147222 Aug 30 00:01:24.522669 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 128/273] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:24 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:24.551180 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:24.551807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:24.558907 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.559381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.559818 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.560499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.560946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.561368 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.686285 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.692908 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:24.693507 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:24.694897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.696343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.697500 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ff4145da-97e2-440c-8d69-5a554b4bea91 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.150323 Aug 30 00:01:24.698328 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 146/274] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:24 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:24.699753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.700228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.700655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.701335 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.701776 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.702187 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.824822 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.832748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8198d32b-8aeb-47d3-928f-4bf9bf067e05 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.143336 Aug 30 00:01:24.833542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 129/275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:24 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:24.837545 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:24.838730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:24.844584 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.845059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.845483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.846175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.846678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.847097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.906557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.914146 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-91a8e839-ef66-4858-9f9b-eeab0d57948e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1266 microversion: 2.1 time: 0.080454 Aug 30 00:01:24.914726 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 147/276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:24 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:25.172008 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:25.172654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:25.179713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.180191 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.180625 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.181308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.181759 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.182181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.309782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:25.317334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c76245d7-b389-415f-aea9-eaa44326622d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.149324 Aug 30 00:01:25.318049 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 130/277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:25 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:25.542652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:25.543262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:25.549183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.549662 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.550097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.550809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.551261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.551787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.703579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:25.712523 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-264ed40b-7178-49bb-a78a-d9a56a36ec94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.173751 Aug 30 00:01:25.713104 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 148/278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:25 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:25.723791 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:25.724464 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:25.731331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.731880 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.732654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.733242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.733786 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.734268 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.854403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:25.855206 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:25.861330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.861946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.862645 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.863464 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.864024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.864561 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.955974 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:25.965139 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:25.966649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:25.968269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-da3619ef-5caa-4d3d-a4be-bcb3914d8824 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.248431 Aug 30 00:01:25.972485 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 131/279] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:25 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:25.977154 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:25.977708 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:25.985899 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.986227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.986671 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.987481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.987810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.988225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.008790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:26.017329 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e27a9722-fcc2-43e5-8c64-ca1ae6b43b92 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.166781 Aug 30 00:01:26.018127 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 149/280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:25 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:26.052301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:26.059154 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-eb0fdccd-86bc-4d06-845a-7c287251645c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1266 microversion: 2.1 time: 0.085624 Aug 30 00:01:26.059713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 132/281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:25 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:26.338782 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:26.340181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:26.345878 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.346352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.346888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.347565 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.348013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.348428 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.479506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:26.487886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4433d087-b295-4cea-8d09-2526f405a516 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.153027 Aug 30 00:01:26.488461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 150/282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:26 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:26.537803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-300c7949-65ac-4619-a708-3e09094116a9 req-2b33cbab-e577-4575-bb23-733aee1cc143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9105900-32ff-4338-bffd-cdf09407a6a6", "name": "network-vif-plugged", "status": "completed", "tag": "2e3fc215-ce48-4169-86c0-77d59d94c4ab"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:26.548010 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-300c7949-65ac-4619-a708-3e09094116a9 req-2b33cbab-e577-4575-bb23-733aee1cc143 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.548653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-300c7949-65ac-4619-a708-3e09094116a9 req-2b33cbab-e577-4575-bb23-733aee1cc143 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.549212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-300c7949-65ac-4619-a708-3e09094116a9 req-2b33cbab-e577-4575-bb23-733aee1cc143 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.561374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-300c7949-65ac-4619-a708-3e09094116a9 req-2b33cbab-e577-4575-bb23-733aee1cc143 service nova] Creating event network-vif-plugged:2e3fc215-ce48-4169-86c0-77d59d94c4ab for instance a9105900-32ff-4338-bffd-cdf09407a6a6 on hv-cinder-85427 Aug 30 00:01:26.566442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-300c7949-65ac-4619-a708-3e09094116a9 req-2b33cbab-e577-4575-bb23-733aee1cc143 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032825 Aug 30 00:01:26.567443 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 133/283] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:01:26.733880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:26.734504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:26.740843 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.741322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.741754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.742684 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.743139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.743587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.882727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:26.894356 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fdbc4f5d-345f-4c42-9bee-93cdbca068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.164276 Aug 30 00:01:26.896024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 151/284] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:26 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:26.896399 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:26.897116 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:26.904017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.904785 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.905222 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.905923 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.906380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.906827 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.935110 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b16263ea-5d8e-4276-84e8-2af39a1f4194 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/ips" status: 200 len: 146 microversion: 2.1 time: 0.043234 Aug 30 00:01:26.935741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 134/285] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:01:26 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:26.990357 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:26.990986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:26.998021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.998540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.998975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.999666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.000119 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.000539 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.038278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:27.038907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:27.050741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.051674 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.052114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.052823 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.053617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.054385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.140466 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:27.149344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:27.151003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:27.152711 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c1ece66e-63a6-45e3-862f-5abeeb0736a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.166186 Aug 30 00:01:27.156966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 152/286] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:26 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:27.158236 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:27.158866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:27.164881 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.165373 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.166160 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.166513 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.167030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.168020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.237372 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:27.241040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:27.246108 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c89e334a-4803-4fc2-bc37-4fde70838986 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1272 microversion: 2.1 time: 0.091111 Aug 30 00:01:27.246748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 153/287] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:27 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:27.317000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:27.325650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-078449bf-7118-468c-8088-e888213fdc97 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.291240 Aug 30 00:01:27.326224 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 135/288] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:27 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:27.509291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:27.509911 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:27.516612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.517097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.517533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.518337 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.518834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.519261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.649790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:27.658345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-545d002e-5bdb-4bd2-8cb6-68e2be528b24 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.153415 Aug 30 00:01:27.658955 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 154/289] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:27 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:27.918522 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:27.919132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:27.925898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.926496 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.926920 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.927622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.928069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.928490 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.165379 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.174959 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3db16037-8358-40fa-ab1d-1d1e3f77f001 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.258965 Aug 30 00:01:28.174959 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 136/290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:27 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:28.192389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:28.192900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:28.200311 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.200796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.201223 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.201909 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.202352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.202796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.269226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:28.269945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:28.276051 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.276647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.277151 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.277928 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.278443 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.278972 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.384228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.393910 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.396311 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.397760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4d0d8677-38c3-4f27-84a8-a9c536593e5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.209622 Aug 30 00:01:28.398433 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 155/291] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:28 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:28.404708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:28.405624 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:28.411974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.412574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.413291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.414093 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.414847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.415376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.563026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.580649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4cf427e0-5955-4278-9894-f70e79482e86 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.311113 Aug 30 00:01:28.597203 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 137/292] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:28 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:28.634673 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.643873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d0ed3a3f-2cdc-4a3a-96e8-6eb6a1c5c87b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.243582 Aug 30 00:01:28.644760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 156/293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:28 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:28.679342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:28.680129 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:28.683671 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:28.691016 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.692050 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.701520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.703204 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.706126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.706756 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.723767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-cf221e01-e64f-4fbb-8b2d-e0168678e401 req-a7a14347-1bbd-4e13-8696-da49d7e19f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb1c11e-eeb2-4b6d-94e1-4b421346f429", "tag": "6bfa03e3-475a-4c6e-bd1f-bec31c6acfa9"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:28.746230 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-cf221e01-e64f-4fbb-8b2d-e0168678e401 req-a7a14347-1bbd-4e13-8696-da49d7e19f76 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.748300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-cf221e01-e64f-4fbb-8b2d-e0168678e401 req-a7a14347-1bbd-4e13-8696-da49d7e19f76 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.751632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-cf221e01-e64f-4fbb-8b2d-e0168678e401 req-a7a14347-1bbd-4e13-8696-da49d7e19f76 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.762327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-cf221e01-e64f-4fbb-8b2d-e0168678e401 req-a7a14347-1bbd-4e13-8696-da49d7e19f76 service nova] Creating event network-changed:6bfa03e3-475a-4c6e-bd1f-bec31c6acfa9 for instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 on hv-cinder-85427 Aug 30 00:01:28.768461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-cf221e01-e64f-4fbb-8b2d-e0168678e401 req-a7a14347-1bbd-4e13-8696-da49d7e19f76 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049149 Aug 30 00:01:28.769343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 157/294] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:28.880697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.890260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0eb82467-94fc-42a8-bbd4-d23b97dd38d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.215040 Aug 30 00:01:28.891074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 138/295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:28 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:29.194691 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:29.195429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:29.202743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.203226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.203661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.204358 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.204810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.205240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.426041 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:29.427470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:29.430388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=4 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:29.431380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=24 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:29.438813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.439581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.440410 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.441535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.442427 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.443055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.455483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:29.466579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a4a8ad49-c0ef-47b6-a557-afaa15680cae tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1368 microversion: 2.1 time: 0.274835 Aug 30 00:01:29.481380 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 158/296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:29 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:29.604187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:29.605029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:29.611138 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.611629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.612144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.612827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.613275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.613688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.664991 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:29.673683 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:29.675271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:29.676615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7a06f7b1-b109-42a5-a4a2-2d7221805265 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.256544 Aug 30 00:01:29.677188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 139/297] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:29 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:29.697561 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:29.698232 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:29.706988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.707468 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.708105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.709011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.709464 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.709885 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.759971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:29.774588 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-215669fc-53e0-42b7-b177-29058b9a00d6 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.170736 Aug 30 00:01:29.774588 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 159/298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:29 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:29.849633 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:29.862017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6e337034-a66f-4ea5-9c44-2af59bc680d4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.172822 Aug 30 00:01:29.862017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 140/299] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:29 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:29.910803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:29.912050 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:29.918595 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.919079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.919514 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:29.921051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:29.921051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:29.921051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.083680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:30.091536 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c97555e1-407e-4759-8345-ecce2eee7158 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.184477 Aug 30 00:01:30.092137 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 160/300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:29 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:30.492428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:30.493638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:30.506079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.506626 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.507463 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.508525 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.509319 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.509896 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.577331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-da26eab6-3a59-4bd3-ae6b-5758db8c92c3 req-b61341ba-1139-4de2-8f2c-aacd93d2c876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0e6e6d-8147-432e-bb65-a51972dcc8c6", "name": "network-vif-plugged", "status": "completed", "tag": "6d8b21ec-d874-4517-9c4d-31c0a7bad3ec"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:30.610211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-da26eab6-3a59-4bd3-ae6b-5758db8c92c3 req-b61341ba-1139-4de2-8f2c-aacd93d2c876 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.610999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-da26eab6-3a59-4bd3-ae6b-5758db8c92c3 req-b61341ba-1139-4de2-8f2c-aacd93d2c876 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.612096 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-da26eab6-3a59-4bd3-ae6b-5758db8c92c3 req-b61341ba-1139-4de2-8f2c-aacd93d2c876 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.626288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-da26eab6-3a59-4bd3-ae6b-5758db8c92c3 req-b61341ba-1139-4de2-8f2c-aacd93d2c876 service nova] Creating event network-vif-plugged:6d8b21ec-d874-4517-9c4d-31c0a7bad3ec for instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 on hv-cinder-85427 Aug 30 00:01:30.633025 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-da26eab6-3a59-4bd3-ae6b-5758db8c92c3 req-b61341ba-1139-4de2-8f2c-aacd93d2c876 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059731 Aug 30 00:01:30.634258 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 161/301] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:30.652152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6eec293-3116-4b8b-ad54-0c40a329956b"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:30.652152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:30.658957 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.659512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.659969 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.660703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.661159 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.661582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.944635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:30.951366 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:30.958231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-52c68d32-be9e-42f7-930b-25e014d85b21 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1557 microversion: 2.1 time: 0.473977 Aug 30 00:01:30.959478 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 141/302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:30 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1557 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:30.965045 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:30.965893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:30.973088 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.973574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.974030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.974783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.975234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.975658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.135214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.144443 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.145933 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.147329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fb83acc8-1f1f-46e7-b62b-e8356ee28112 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.186671 Aug 30 00:01:31.147903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 142/303] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:30 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:31.153057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:31.153651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:31.168854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.169494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.170105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.170850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.171598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.171942 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.365672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.373097 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6bab3b23-6458-42b2-8d05-8a3dfa2243d1 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.224254 Aug 30 00:01:31.373821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 143/304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:31 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:31.378140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:31.378760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:31.384359 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.384830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.385252 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.386310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.386836 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.387259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.518681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.526381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3b3cf555-0ee1-44fb-96ef-52e9a8c87309 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.151505 Aug 30 00:01:31.527480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 144/305] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:31 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:31.532256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:31.532797 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:31.538780 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.539261 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.539789 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.540474 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.540925 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.541342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.545237 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4cb7ddd2-4645-4543-9df3-681fd7647349 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908656 Aug 30 00:01:31.550241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 162/306] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:01:30 2022] POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-volume_attachments => generated 194 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:31.551333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:31.552027 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:31.559135 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.559623 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.560061 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.560757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.561212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.561637 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.635541 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c0090b19-05e0-4e53-a950-00a9fff47620 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106342 Aug 30 00:01:31.636855 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 145/307] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:01:31 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:31.824482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.832197 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-105ed487-e34c-4bcd-9e63-de2f7f0300db tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.284845 Aug 30 00:01:31.832761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 163/308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:31 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:32.173023 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:32.173626 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:32.179487 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.180007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.180438 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.181276 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.181558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.182117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.309946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:32.318259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:32.319834 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:32.321077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0f130342-92b7-4150-a00f-a1814ec10454 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.152031 Aug 30 00:01:32.321943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 146/309] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:32 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:32.394265 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:32.394992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:32.402059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.402724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.403346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.404048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.404506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.404934 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.547093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:32.547726 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:32.553591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.554070 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.554519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.555209 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.555657 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.556071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.624776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:32.633143 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9dfa0f45-5417-44a1-9c66-8a0750cea906 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.242624 Aug 30 00:01:32.633881 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 164/310] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:32 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:32.814028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-12e78651-e6dc-4e50-bb47-de45cf37868f req-8d08d9e7-ba49-46e3-a1fc-d7c20286b692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9105900-32ff-4338-bffd-cdf09407a6a6", "tag": "2e3fc215-ce48-4169-86c0-77d59d94c4ab"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:32.824416 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-12e78651-e6dc-4e50-bb47-de45cf37868f req-8d08d9e7-ba49-46e3-a1fc-d7c20286b692 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.824798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-12e78651-e6dc-4e50-bb47-de45cf37868f req-8d08d9e7-ba49-46e3-a1fc-d7c20286b692 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.825338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-12e78651-e6dc-4e50-bb47-de45cf37868f req-8d08d9e7-ba49-46e3-a1fc-d7c20286b692 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.833551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:32.836165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-12e78651-e6dc-4e50-bb47-de45cf37868f req-8d08d9e7-ba49-46e3-a1fc-d7c20286b692 service nova] Creating event network-changed:2e3fc215-ce48-4169-86c0-77d59d94c4ab for instance a9105900-32ff-4338-bffd-cdf09407a6a6 on hv-cinder-85427 Aug 30 00:01:32.841244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-12e78651-e6dc-4e50-bb47-de45cf37868f req-8d08d9e7-ba49-46e3-a1fc-d7c20286b692 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030853 Aug 30 00:01:32.842204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 165/311] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:01:32.842670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6ff72a84-3407-4371-883c-88ddeea39896 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.299370 Aug 30 00:01:32.848160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 147/312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:32 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:32.853681 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:32.854417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:32.860585 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.861065 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.861503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.862188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.862685 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.863111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.994089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:33.002019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-801add76-d442-4da1-9885-322b68bab7d3 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.152556 Aug 30 00:01:33.002664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 166/313] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:32 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:33.344750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:33.345415 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:33.351384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.351864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.352293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.352987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.353455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.353858 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.488269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:33.494791 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:33.496436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:33.497715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dfb5a1ae-f201-4b61-8bd2-b1e0c2c3de49 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.156819 Aug 30 00:01:33.498304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 148/314] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:33 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:33.654962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:33.655578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:33.662124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.662655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.663092 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.663790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.664402 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.664646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.819316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:33.827586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-339170d9-410a-4750-8f0a-c56e9378d2fb tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.177061 Aug 30 00:01:33.828184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 167/315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:33 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:33.863653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:33.864250 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:33.870121 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.870641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.871076 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.871767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.872300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.872723 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.003755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:34.012088 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-274dce27-ba32-456e-aef5-e2ccba184880 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.152245 Aug 30 00:01:34.012651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 149/316] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:33 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:34.027756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:34.028818 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:34.034332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.034847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.035282 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.035967 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.036418 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.036840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.165863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:34.173425 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8ae48296-1094-42ce-8a6f-1adb243bdd02 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.153269 Aug 30 00:01:34.173995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 168/317] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:34 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:34.525883 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:34.526534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:34.533150 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.533629 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.534062 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.534832 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.535279 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.535697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.660495 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:34.668497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:34.669944 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:34.671112 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dcd944d1-de3a-402e-aa13-b424434e1f7c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.149148 Aug 30 00:01:34.671660 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 150/318] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:34 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:34.849208 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:34.851360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:34.859005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.859490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.859924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.860867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.861255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.861873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.996811 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.004461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4d2ed993-0721-4c12-8d5d-2412ae3b50b3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.159807 Aug 30 00:01:35.011586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 169/319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:34 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:35.032808 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:35.033423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:35.039478 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.039957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.040390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.041080 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.041531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.041954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.168247 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.175898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fb6c1d6d-0c53-4f8f-860f-7099e278cbb2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1501 microversion: 2.1 time: 0.146967 Aug 30 00:01:35.178178 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 151/320] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:35 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1501 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:35.194861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:35.195474 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:35.197436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f67007f-729d-4f19-b2a9-a116c7abf215"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:35.199845 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:35.201490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.201976 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.202412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.206797 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.206797 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.206797 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.207061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.207061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.207061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.207431 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.207811 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.208229 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.231212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] HTTP exception thrown: Cannot 'attach_volume' instance 3df5b062-9099-42fa-9bcc-40d56163ce2b while it is in vm_state rescued Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Request method failure captured: Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: POST /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b/os-volume_attachments HTTP/1.1 Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 74 Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLqpgnE_Ii-S0Ne3Nsfgbd6JBmuliRuSshaGbLD5BOvWn30wij20w9qsKcR37vZB8fQAPEAA2E90vUrUAMDGzq_dBiWr5GoRvMro0QKlSEsyvAy3pEzbh8pz9RNTkvlj0eUgF0x4KUqWetwmdI46ldVB-vEV1KhwJH--SzNfuJ376I Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:01:35.233130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}] Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: e0a5a4228c5d41c7898aa768dfe359ca Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {"volumeAttachment": {"volumeId": "6f67007f-729d-4f19-b2a9-a116c7abf215"}} Aug 30 00:01:35.234758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Cannot 'attach_volume' instance 3df5b062-9099-42fa-9bcc-40d56163ce2b while it is in vm_state rescued Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'server_id': '3df5b062-9099-42fa-9bcc-40d56163ce2b', 'body': {'volumeAttachment': {'volumeId': '6f67007f-729d-4f19-b2a9-a116c7abf215'}}} Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3df5b062-9099-42fa-9bcc-40d56163ce2b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:01:35.236447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3df5b062-9099-42fa-9bcc-40d56163ce2b while it is in vm_state rescued Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:35.237618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:35.238874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:01:35.238874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:01:35.238874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3df5b062-9099-42fa-9bcc-40d56163ce2b while it is in vm_state rescued Aug 30 00:01:35.238874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:01:35.238874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Returning 409 to user: Cannot 'attach_volume' instance 3df5b062-9099-42fa-9bcc-40d56163ce2b while it is in vm_state rescued {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:01:35.238874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e57240b5-9689-49fd-aff3-722425e12336 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041359 Aug 30 00:01:35.238874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 152/321] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:01:35 2022] POST /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 00:01:35.243640 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:35.247180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:35.250965 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.251481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.251914 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.252604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.253050 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.253465 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.333072 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.341063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d3b7584f-fe87-4b8b-b571-0e92bdcca3c9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1313 microversion: 2.1 time: 0.150162 Aug 30 00:01:35.341800 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 170/322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:35 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:35.463670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3ae01c78-5cd1-47d6-9836-9b3d094352e5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b/action" status: 202 len: 0 microversion: 2.1 time: 0.223505 Aug 30 00:01:35.464482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 153/323] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:01:35 2022] POST /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:01:35.472542 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:35.473144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:35.480257 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.480983 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.481419 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.482117 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.482590 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.483011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.487176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:35.611304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.618974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aa5d8659-2ca8-4bc9-8bc8-003e2b8ab244 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1509 microversion: 2.1 time: 0.150229 Aug 30 00:01:35.619471 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 171/324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:35 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:35.693572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:35.694326 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:35.700612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.701089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.701524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.702239 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:35.702720 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:35.703144 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.889382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.902406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.904075 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.905621 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5db3e224-b073-47d7-a84b-2937096581a7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.216342 Aug 30 00:01:35.906841 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 154/325] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:35 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:36.025240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:36.025846 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:36.033671 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.041049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.041049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.041049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.041049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.041417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.182185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:36.190216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4f1f657a-5d5c-4084-8120-8c37fa07bfcd tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.168812 Aug 30 00:01:36.190806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 172/326] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:36 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:36.361146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:36.361751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:36.367773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.368249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.368681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.369363 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.370318 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.372605 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.502988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:36.511453 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ba00a44c-cd7a-4809-863c-9c08476fc26b tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1463 microversion: 2.1 time: 0.153346 Aug 30 00:01:36.512024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 155/327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:36 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:36.560683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:36.561179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:36.567327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.567813 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.568246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.568935 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.569384 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.569806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.595852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:01:36.641435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:36.641435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:36.646684 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.647165 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.647601 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.648285 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.648738 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.649160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.784982 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:36.793048 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a1dfe724-e765-4da7-9824-d91bf1f77e7f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1509 microversion: 2.1 time: 0.157749 Aug 30 00:01:36.793614 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 156/328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:36 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:36.900355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4e8b7c3e-5cba-419f-8956-50e41e01e0ee tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 204 len: 0 microversion: 2.1 time: 0.344977 Aug 30 00:01:36.900937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 173/329] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:01:36 2022] DELETE /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:36.909224 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:36.911573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:36.919879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.920389 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.920813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.921592 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.922046 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.922492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.932075 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:36.933862 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:36.944520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.944997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.945430 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.946135 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.946609 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.947025 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.140386 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:37.151510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:37.153352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:37.155357 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-48771824-2ac1-4a79-8b0a-9131f6894839 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.227285 Aug 30 00:01:37.157206 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 174/330] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:36 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:37.199918 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:37.209799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-46ac3af7-0bdd-4920-8546-c8bc34dd4ff7 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1469 microversion: 2.1 time: 0.304348 Aug 30 00:01:37.210594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 157/331] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:36 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:37.210949 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:37.211568 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:37.218541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:37.219035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:37.219466 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.220155 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:37.220608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:37.221030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.352271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:37.360577 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b6263726-a4db-4af5-aa45-85694d36fb89 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.153841 Aug 30 00:01:37.361152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 175/332] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:37 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:37.814157 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:37.814734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:37.820679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:37.821155 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:37.821584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.822331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:37.823429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:37.823890 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.827881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:37.949395 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:37.957104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a8f1d88c-401b-4c57-b9dc-993e43e3131f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1509 microversion: 2.1 time: 0.146903 Aug 30 00:01:37.957662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 158/333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:37 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:38.180352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:38.180986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:38.188066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.188550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.188982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.189669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.190117 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.190558 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.232114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:38.232714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:38.238789 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.239342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.239784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.240507 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.240928 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.241349 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.325345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:38.333946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:38.335521 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:38.337334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ca498b31-6b79-4629-af7e-08494b8d36a5 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.160877 Aug 30 00:01:38.337903 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 176/334] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:38 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:38.384015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:38.385852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:38.396108 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.396966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.397744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.398986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.399847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.400593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.405313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:38.413509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2f9c5561-57c9-439c-b484-a32bd55e1673 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1469 microversion: 2.1 time: 0.185689 Aug 30 00:01:38.414184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 159/335] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:38 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:38.534724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:38.542938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-089f1fe1-4fdc-49e6-b43e-af858f8b01ad tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.165945 Aug 30 00:01:38.543495 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 177/336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:38 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:38.978284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:38.978916 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:38.985055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.985541 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.985969 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.986756 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.987226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.987672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:39.360221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:39.360756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:39.367257 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:39.367743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:39.368176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:39.368873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:39.369322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:39.370255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:39.418099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:39.442831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-93bd5308-056a-4784-8633-1d0169b3a88f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1509 microversion: 2.1 time: 0.468374 Aug 30 00:01:39.443684 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 160/337] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:38 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:39.449422 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:39.450227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:39.456899 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:39.457572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:39.458295 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:39.459287 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:39.459881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:39.460445 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:39.543840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:39.552763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:39.554215 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:39.555427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f9b64d74-286f-4412-8674-e22f2a9fa671 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.199225 Aug 30 00:01:39.555978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 178/338] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:39 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:39.563777 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:39.564471 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:39.570743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:39.571306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:39.571798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:39.572754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:39.573769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:39.574289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:39.720792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:39.729473 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-600bb7a3-82fb-4646-b0b8-4226a6a55795 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.169059 Aug 30 00:01:39.730300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 179/339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:39 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.219392 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:40.227479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9578424f-bf22-4818-bdac-0b7e7fd280f4 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1469 microversion: 2.1 time: 0.782646 Aug 30 00:01:40.228417 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 161/340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:39 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1469 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.467938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:40.468577 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:40.476364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.476861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.477294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.478187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.478678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.479880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.579061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:40.580021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:40.587802 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.588837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.589516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.593115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.593115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.593115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.641181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:40.649023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e32ae834-f5b3-4e91-9578-6053dbfa5958 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1509 microversion: 2.1 time: 0.184996 Aug 30 00:01:40.649718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 180/341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:40 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.751176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:40.751793 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:40.757740 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.758246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.759469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.759469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.759821 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.761148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.913388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:40.914681 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:40.922703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-75de7e1b-abfa-4d78-b510-e1af0cdfe826 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.175342 Aug 30 00:01:40.924316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 181/342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:40 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.924439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:40.926794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:40.928063 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c055f5c0-218f-45f5-9811-a886d8cc3677 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1744 microversion: 2.20 time: 0.352981 Aug 30 00:01:40.929837 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-dac404cb-0492-4df3-886f-8193169234ae req-0d11ba4b-3c88-4d7a-af68-424b8dc3b4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0e6e6d-8147-432e-bb65-a51972dcc8c6", "name": "network-vif-deleted", "tag": "6d8b21ec-d874-4517-9c4d-31c0a7bad3ec"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:40.938043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 162/343] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:40 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1744 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:40.942842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-dac404cb-0492-4df3-886f-8193169234ae req-0d11ba4b-3c88-4d7a-af68-424b8dc3b4e4 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.946537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-dac404cb-0492-4df3-886f-8193169234ae req-0d11ba4b-3c88-4d7a-af68-424b8dc3b4e4 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.946537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-dac404cb-0492-4df3-886f-8193169234ae req-0d11ba4b-3c88-4d7a-af68-424b8dc3b4e4 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.956881 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-dac404cb-0492-4df3-886f-8193169234ae req-0d11ba4b-3c88-4d7a-af68-424b8dc3b4e4 service nova] Creating event network-vif-deleted:6d8b21ec-d874-4517-9c4d-31c0a7bad3ec for instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 on hv-cinder-85427 Aug 30 00:01:40.961959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-dac404cb-0492-4df3-886f-8193169234ae req-0d11ba4b-3c88-4d7a-af68-424b8dc3b4e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036289 Aug 30 00:01:40.962622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 182/344] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:41.249657 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:41.250255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:41.256043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.256520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.256944 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.257619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.258062 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.258558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.319940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:41.327671 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f86ab846-a62d-43a3-9a8c-63ab3cf9a9d9 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1427 microversion: 2.1 time: 0.081846 Aug 30 00:01:41.328240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 163/345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:41 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:41.671777 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:41.672471 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:41.678716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.679195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.679628 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.680336 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.680772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.681196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.811476 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:41.819201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d7903177-47b4-4d37-a3e0-ad5b5fc46c96 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1509 microversion: 2.1 time: 0.152908 Aug 30 00:01:41.819770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 183/346] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:41 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:41.945418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:41.946030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:41.952545 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.953031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.953466 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.954189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.954734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.955096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.955648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:41.956270 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:41.964087 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:41.965902 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.966558 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.967151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.968527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.969007 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.969611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.116710 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:42.119866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:42.126395 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e5b69438-433a-4b34-a277-41d915b3374e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.184918 Aug 30 00:01:42.128296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:42.128542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 164/347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:41 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:42.130276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:42.131556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2f3dd286-0dc2-46b5-bf9c-230043ffa579 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1744 microversion: 2.20 time: 0.180913 Aug 30 00:01:42.132195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 184/348] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:41 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:42.348671 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:42.349304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:42.355850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:42.356221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:42.356660 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.357349 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:42.357802 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:42.358221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.429204 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:42.443288 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2ac50b03-f7fe-4a89-938b-b1aecdb7e550 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1298 microversion: 2.1 time: 0.093386 Aug 30 00:01:42.443288 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 165/349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:42 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:42.832326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-600a84c6-fe20-4347-9e78-2b4563764001 req-1f23d3bf-ee5f-49ea-bd1e-afef9102145d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb1c11e-eeb2-4b6d-94e1-4b421346f429", "name": "network-vif-plugged", "status": "completed", "tag": "6bfa03e3-475a-4c6e-bd1f-bec31c6acfa9"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:42.842234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:42.843029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:42.849363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-600a84c6-fe20-4347-9e78-2b4563764001 req-1f23d3bf-ee5f-49ea-bd1e-afef9102145d service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:42.849761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-600a84c6-fe20-4347-9e78-2b4563764001 req-1f23d3bf-ee5f-49ea-bd1e-afef9102145d service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:42.850287 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-600a84c6-fe20-4347-9e78-2b4563764001 req-1f23d3bf-ee5f-49ea-bd1e-afef9102145d service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.863291 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:42.868553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:42.869401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.870853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-600a84c6-fe20-4347-9e78-2b4563764001 req-1f23d3bf-ee5f-49ea-bd1e-afef9102145d service nova] Creating event network-vif-plugged:6bfa03e3-475a-4c6e-bd1f-bec31c6acfa9 for instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 on hv-cinder-85427 Aug 30 00:01:42.871786 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:42.874044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:42.879258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.880614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-600a84c6-fe20-4347-9e78-2b4563764001 req-1f23d3bf-ee5f-49ea-bd1e-afef9102145d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052381 Aug 30 00:01:42.881528 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 185/350] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:43.042185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:43.049976 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f436af9e-5613-43c9-a5b9-f353b2bc7511 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1509 microversion: 2.1 time: 0.213155 Aug 30 00:01:43.050573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 166/351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:42 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:43.149628 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:43.150431 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:43.157836 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.158394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.158916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.159255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:43.159789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.159918 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:43.160381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.160864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.165772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.166255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.167284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.167969 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.168416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.168835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.299896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:43.301266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:43.307990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-704056a3-3bfb-4146-ab3e-5dff5b729fa3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.163851 Aug 30 00:01:43.308961 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 186/352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:43 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:43.321718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:43.321718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:43.321718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cadbac15-7224-4999-b498-5c032c7f9f32 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1744 microversion: 2.20 time: 0.158327 Aug 30 00:01:43.324924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 167/353] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:43 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:43.461199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:43.461809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:43.468448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.468932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.469365 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.470056 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.470531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.470955 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.501821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.502215 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.502713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.503165 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lazy-loading 'fault' on Instance uuid 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:43.550449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:43.559211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9450a91e-c78b-442b-946f-3cbf7037f9b2 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1303 microversion: 2.1 time: 0.101668 Aug 30 00:01:43.559981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 168/354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:43 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:44.071015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:44.071730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:44.080061 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.080607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.081040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.081756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.082204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.082646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.100720 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.329555 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:44.333078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:44.339681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.342800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.342800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.342800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.342800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.343134 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.473988 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:44.487321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1ba6ce11-dcae-467a-8543-68c7cac92188 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1515 microversion: 2.1 time: 0.420293 Aug 30 00:01:44.488503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 187/355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:44 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1515 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:44.495221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:44.496598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:44.513031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.513832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.514560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.516151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.516754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.517287 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.544218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:44.552336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-865cdee9-2c66-4c62-b394-5f444a451692 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.226777 Aug 30 00:01:44.554213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 169/356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:44 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:44.585706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:44.586544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:44.593539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.594163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.594728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.595665 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.596325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.596854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.641047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.642248 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.642948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.643553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lazy-loading 'fault' on Instance uuid 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:44.693392 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:44.702441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3a2ddcc4-bc6b-4b3b-b3d5-d16efd811ffa tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1303 microversion: 2.1 time: 0.120878 Aug 30 00:01:44.711248 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 170/357] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:44 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:44.715302 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:44.725547 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:44.727019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:44.728171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-31ac2c6a-cec1-4f88-b93b-6f024a6ea5bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.238143 Aug 30 00:01:44.730812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 188/358] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:44 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:44.897475 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-529ea980-816a-49c4-a5c0-71909b45706c req-baf628ea-f452-4c48-aec6-f9e9f1678601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa3cd3e-c701-4851-a613-4c89ea690072", "name": "network-vif-plugged", "status": "completed", "tag": "7aa950fd-42ef-47f2-90db-cffca1a6595c"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:44.907574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-529ea980-816a-49c4-a5c0-71909b45706c req-baf628ea-f452-4c48-aec6-f9e9f1678601 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:44.908056 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-529ea980-816a-49c4-a5c0-71909b45706c req-baf628ea-f452-4c48-aec6-f9e9f1678601 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:44.908632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-529ea980-816a-49c4-a5c0-71909b45706c req-baf628ea-f452-4c48-aec6-f9e9f1678601 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.920594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-529ea980-816a-49c4-a5c0-71909b45706c req-baf628ea-f452-4c48-aec6-f9e9f1678601 service nova] Creating event network-vif-plugged:7aa950fd-42ef-47f2-90db-cffca1a6595c for instance bfa3cd3e-c701-4851-a613-4c89ea690072 on hv-cinder-85427 Aug 30 00:01:44.926009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-529ea980-816a-49c4-a5c0-71909b45706c req-baf628ea-f452-4c48-aec6-f9e9f1678601 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032063 Aug 30 00:01:44.926750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 171/359] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:45.577416 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:45.579221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:45.589651 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:45.590579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:45.591759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:45.593470 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:45.595020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:45.595961 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:45.725061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:45.726064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:45.732734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:45.733531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:45.733959 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:45.734889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:45.735559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:45.735977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:45.783944 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:45.784420 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:45.785512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:45.786625 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lazy-loading 'fault' on Instance uuid 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:45.794120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:45.805308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6c5ea569-2d26-4e75-86ca-2b8e74191f4c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1314 microversion: 2.1 time: 0.233399 Aug 30 00:01:45.807122 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 189/360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:45 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:45.814133 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:45.823381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:45.829897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:45.830307 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:45.830774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:45.831514 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:45.832246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:45.832422 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:45.849959 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:45.877322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2393df1b-08bf-4aa7-b339-dfe51907a54d tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1303 microversion: 2.1 time: 0.154581 Aug 30 00:01:45.880564 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 172/361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:45 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:46.013883 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:46.029700 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:46.031489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:46.032874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-acbe2e1f-cbc4-41ed-9f51-23d0bde2919a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.224293 Aug 30 00:01:46.033613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 190/362] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:45 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:46.326690 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-034ca412-d014-441a-9bb3-ba09d67baeb5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'create', calling method: .version_select at 0x7f09bf62aca0>, body: {"keypair": {"name": "tempest-keypair-1452332878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOWeAbh1qmXlRaVKTMLIOWJsKA3kd8QDDbkcGgwoj2fcMMRjb4s4CN6Xk2hn5Pmcjd1NTm03s4yjYm+5PJdSYkdUFaoD62twRVrJfCoMuII5uJiXHQN5bErNVdfj8V8lw=="}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:46.342895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-034ca412-d014-441a-9bb3-ba09d67baeb5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:46.347039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-034ca412-d014-441a-9bb3-ba09d67baeb5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for user e0a5a4228c5d41c7898aa768dfe359ca and project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:46.475008 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-034ca412-d014-441a-9bb3-ba09d67baeb5 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152886 Aug 30 00:01:46.476347 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 173/363] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:01:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:46.836012 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:46.836823 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:46.845687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:46.846632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:46.847303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:46.848982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:46.849950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:46.850695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:46.900141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:46.903111 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:46.913868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:46.914533 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:46.915377 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:46.916257 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:46.916830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:46.917493 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:47.012516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:47.013554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:47.017007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:47.017894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lazy-loading 'fault' on Instance uuid 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:47.090559 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:47.099367 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3b3b6457-2996-449c-a860-cbfa755da63e tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1499 microversion: 2.1 time: 0.268644 Aug 30 00:01:47.100514 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 191/364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:46 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1499 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:47.107186 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:47.107818 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:47.111879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedc3c6fa04140af90274a11fe46a51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87f87f955d84a668c6d75a232b3be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:47.115019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:47.115512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:47.116128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:47.116995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:47.117607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:47.118187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:47.134354 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-23f81678-97bc-4c04-adb4-0a8685cf18d5 tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 200 len: 1303 microversion: 2.1 time: 0.238061 Aug 30 00:01:47.136078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 174/365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:46 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:47.271687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:47.287917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:47.289907 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:47.294638 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b552fb84-1068-43f6-b021-1266ccf41507 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.189676 Aug 30 00:01:47.295375 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 192/366] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:47 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:47.881378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-20b148a3-3e39-4347-af98-d46a30cdd58d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:47.888559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-20b148a3-3e39-4347-af98-d46a30cdd58d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:47.889038 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-20b148a3-3e39-4347-af98-d46a30cdd58d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:47.889462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-20b148a3-3e39-4347-af98-d46a30cdd58d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:47.923167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:47.976397 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-20b148a3-3e39-4347-af98-d46a30cdd58d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Going to try to stop instance {{(pid=127768) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 00:01:48.157085 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:48.157768 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] [instance: 9d0e6e6d-8147-432e-bb65-a51972dcc8c6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:48.164676 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.165171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.165607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.166889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.167345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.167764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.182895 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] HTTP exception thrown: Instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 could not be found. Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Request method failure captured: Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 HTTP/1.1 Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNEFhfFwXU_rdNXV8BirWI5D8zfXjwpBg8-i6QOd5wn84_qpuajHFdrVD8WW05OaMPVddMdtLrTb3m9Sl4I2Ku4W1SrmwfXxREE3NENYHSYMiITVpieP5lMG0_APbV63APaZpk_m2_C0NFR0Bc6Ou25TV4l9Mf3RqqTQQI3fKPPpCo Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: f87f87f955d84a668c6d75a232b3be81 Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesNegativeTest-1746219582 Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:01:48.185812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f87f87f955d84a668c6d75a232b3be81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f87f87f955d84a668c6d75a232b3be81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f87f87f955d84a668c6d75a232b3be81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f87f87f955d84a668c6d75a232b3be81"}]}] Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesNegativeTest-1746219582 Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: f87f87f955d84a668c6d75a232b3be81 Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesNegativeTest-1746219582 Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesNegativeTest-1746219582-project Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: eedc3c6fa04140af90274a11fe46a51a Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesNegativeTest-1746219582-project Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 could not be found. Aug 30 00:01:48.187437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '9d0e6e6d-8147-432e-bb65-a51972dcc8c6'} Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 could not be found. Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:01:48.188321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 could not be found. Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 could not be found. Aug 30 00:01:48.190022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:48.191321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] Returning 404 to user: Instance 9d0e6e6d-8147-432e-bb65-a51972dcc8c6 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:01:48.191321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-009c08c5-1be7-44f2-8790-063bb054e77f tempest-VolumesNegativeTest-1746219582 tempest-VolumesNegativeTest-1746219582-project] 10.222.0.60 "GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6" status: 404 len: 111 microversion: 2.1 time: 0.034217 Aug 30 00:01:48.191321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 193/367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:48 2022] GET /compute/v2.1/servers/9d0e6e6d-8147-432e-bb65-a51972dcc8c6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:01:48.319654 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:48.320652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:48.326732 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.329829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.329829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.329829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.329829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.331232 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.385279 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-20b148a3-3e39-4347-af98-d46a30cdd58d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.508821 Aug 30 00:01:48.385279 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 175/368] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:01:47 2022] POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:01:48.395926 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:48.396902 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:48.408675 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.409744 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.410452 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.412198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.413175 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.414313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.568026 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:48.581959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:48.584062 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:48.588815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-683d05ab-a198-4a3f-bcb8-3d222a23d818 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.272425 Aug 30 00:01:48.594964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 194/369] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:48 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:48.601787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:48.602685 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:48.626764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.627420 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.627934 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.628712 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:48.629310 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:48.629806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:48.676433 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:01:48.684609 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:48.695515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-24a144c1-b312-4390-9416-dfc0d9c56d74 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.304905 Aug 30 00:01:48.696760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 176/370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:48 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:49.088503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aee4afd6-18ac-4249-b19a-e4a1ba254534 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 204 len: 0 microversion: 2.1 time: 0.492033 Aug 30 00:01:49.090402 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 195/371] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:01:48 2022] DELETE /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:49.100634 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:49.101544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:49.112545 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:49.115880 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:49.116352 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:49.117073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:49.117690 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:49.118119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:49.314204 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:49.325308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fb9ade01-3bb4-4cb7-a314-0849d7e633d3 tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1505 microversion: 2.1 time: 0.230448 Aug 30 00:01:49.328406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 177/372] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:49 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:49.615858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:49.617096 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:49.626534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:49.631554 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:49.632278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:49.633209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:49.633831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:49.637031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:49.717494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:49.718790 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:49.733030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:49.733542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:49.733984 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:49.734736 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:49.735225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:49.735619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:49.881212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:49.891320 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:49.893204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:49.894512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7394d6b6-3322-4211-8f64-a4683dce70d3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.283121 Aug 30 00:01:49.895200 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 196/373] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:49 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:49.942612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:49.955318 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c94de206-892d-41ef-99fc-4c6caaef00ef tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.241582 Aug 30 00:01:49.956418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 178/374] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:49 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:50.357026 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:50.361511 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:50.364578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:50.365556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:50.366160 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:50.367105 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:50.367562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:50.368191 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:50.577109 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:50.587385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-42109259", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b7a3909-5ba9-4db0-b334-bd9a41efe3bc"}], "security_groups": [{"name": "tempest-securitygroup--245301642"}], "key_name": "tempest-keypair-1452332878", "user_data": "}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:50.591502 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-106336f2-afa3-4908-942c-65bd0d0d993c tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1505 microversion: 2.1 time: 0.238462 Aug 30 00:01:50.602506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.607306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 197/375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:50 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:50.920575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:50.921207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:50.942455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:50.942964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:50.943395 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:50.944132 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:50.944753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:50.945405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.119139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:51.134066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:51.136498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:51.137987 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a85619ff-1e8c-4b74-95b8-9bcf98677a79 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.221783 Aug 30 00:01:51.139039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 198/376] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:50 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:51.144140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:51.144947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:51.152258 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:51.154298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:51.154930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.156055 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:51.157492 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:51.158553 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.321721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:51.351049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-92a04ef8-7bdb-4be2-8803-28be86ce9041 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.210662 Aug 30 00:01:51.372646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 199/377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:51 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:51.445436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] validate_networks() for [('5b7a3909-5ba9-4db0-b334-bd9a41efe3bc', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:01:51.657331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:51.657331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:51.657331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:51.657331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:51.657660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.657660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:51.657660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:51.657660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.769602 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:51.789975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-749ddc44-80d4-4c2a-9cf5-ca01ea1b967a tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1463 microversion: 2.1 time: 0.178255 Aug 30 00:01:51.804643 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 200/378] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:51 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1463 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:51.829066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-4d909393-0f4b-4167-92c8-0da3074a1a14 req-380a2aa2-c653-4ae4-ad2f-1457b28ec276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb1c11e-eeb2-4b6d-94e1-4b421346f429", "name": "network-vif-deleted", "tag": "6bfa03e3-475a-4c6e-bd1f-bec31c6acfa9"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:51.842393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-4d909393-0f4b-4167-92c8-0da3074a1a14 req-380a2aa2-c653-4ae4-ad2f-1457b28ec276 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:51.843198 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-4d909393-0f4b-4167-92c8-0da3074a1a14 req-380a2aa2-c653-4ae4-ad2f-1457b28ec276 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:51.843761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-4d909393-0f4b-4167-92c8-0da3074a1a14 req-380a2aa2-c653-4ae4-ad2f-1457b28ec276 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:51.857845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-4d909393-0f4b-4167-92c8-0da3074a1a14 req-380a2aa2-c653-4ae4-ad2f-1457b28ec276 service nova] Creating event network-vif-deleted:6bfa03e3-475a-4c6e-bd1f-bec31c6acfa9 for instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 on hv-cinder-85427 Aug 30 00:01:51.868793 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-4d909393-0f4b-4167-92c8-0da3074a1a14 req-380a2aa2-c653-4ae4-ad2f-1457b28ec276 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074691 Aug 30 00:01:51.870434 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 201/379] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:52.162579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:52.163275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:52.172889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.173372 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.173791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.174568 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.175017 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.175434 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.310311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:01:52.310905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:01:52.311218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:01:52.311617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:01:52.312040 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:01:52.330549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.330549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.330549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.331182 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:52.338838 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:52.340805 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:52.343236 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.343236 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.343559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.345264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1a5ca11b-9f23-4f5d-b253-8b33cf30dc7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.187715 Aug 30 00:01:52.346362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 202/380] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:52 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:52.381194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:52.381194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:52.387614 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:52.392180 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.392692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.393111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.394019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.394876 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Getting quotas for user e0a5a4228c5d41c7898aa768dfe359ca and project 9d6a508fae014aeb8e7d97b74e3071a4. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:52.395202 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.395930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.410403 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:01:52.412997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:01:52.575016 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-486b17d1-8c1a-4bf7-a4bb-74c04e0bf646 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.992887 Aug 30 00:01:52.576011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:52.585391 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.586693 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 179/381] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:01:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:01:52.594273 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2a88226a-cb17-4d47-ac80-f93cdca49939 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:52.595598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2a88226a-cb17-4d47-ac80-f93cdca49939 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:52.605798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0c1b4bdd-8384-4e0c-b681-d6647f796750 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.236151 Aug 30 00:01:52.631407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 203/382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:52 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:52.659953 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2a88226a-cb17-4d47-ac80-f93cdca49939 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:52.677604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2a88226a-cb17-4d47-ac80-f93cdca49939 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1244 microversion: 2.1 time: 0.089533 Aug 30 00:01:52.678191 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 180/383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:52 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:52.831204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:52.831895 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:52.841318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.841824 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.842271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.844893 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.846776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.847614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.895664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:52.896420 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:52.897027 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:52.907822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lazy-loading 'fault' on Instance uuid 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:52.985072 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01bff0f027d44af4a9f6aeeafa16c27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0619f86cdbc8483d870cd5ac288312e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:53.003962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e5264b70-c6a0-4465-ae68-c88de429baef tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 200 len: 1304 microversion: 2.1 time: 0.177179 Aug 30 00:01:53.017993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 204/384] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:52 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 1304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:53.368898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:53.370490 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:53.377250 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.378504 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.378888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.379839 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.380670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.381315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.555875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:53.566302 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:53.568353 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:53.569749 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fff96087-2b45-41fc-83b8-e18b142091f8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.205272 Aug 30 00:01:53.570836 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 181/385] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:53 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:01:53.630952 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:53.632190 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:53.647632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.648362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.648805 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.649524 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.650185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.650642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.703943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:53.704469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:53.713696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.714678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.715391 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.716119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:53.716582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:53.717005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:53.816478 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:53.829192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:53.831744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7c91e3b2-bdd2-4cd7-853a-58879a28b696 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.204326 Aug 30 00:01:53.846079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 205/386] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:53 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:53.846205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-91109b86-3fa6-4c2e-a7c6-6ffd3f175e73 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1248 microversion: 2.1 time: 0.139655 Aug 30 00:01:53.846205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 182/387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:53 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1248 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:54.027708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:54.028706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] [instance: 3cb1c11e-eeb2-4b6d-94e1-4b421346f429] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:54.038353 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.039007 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.039659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.040329 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.041631 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.042426 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.061272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] HTTP exception thrown: Instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 could not be found. Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Request method failure captured: Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 HTTP/1.1 Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVM1UUrm026RnlBUnvi1J3HfF4UXT1dnv864JVVs_VPEp0994sOkKAHHYK1SS0a5rSYLtGHxblwYe_q848ej3qcxFMOkdd-0ujAbru6cgun_MCQqtb6qyTl5l9NDwGcCS1yo4VT7hvVNbpg-CFMusxFyJPNWkVuCuUWTD04_fij9ixk Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 0619f86cdbc8483d870cd5ac288312e6 Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesActionsTest-965781585 Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:01:54.063355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0619f86cdbc8483d870cd5ac288312e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0619f86cdbc8483d870cd5ac288312e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0619f86cdbc8483d870cd5ac288312e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0619f86cdbc8483d870cd5ac288312e6"}]}] Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesActionsTest-965781585 Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 0619f86cdbc8483d870cd5ac288312e6 Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesActionsTest-965781585 Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesActionsTest-965781585-project Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 01bff0f027d44af4a9f6aeeafa16c27d Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesActionsTest-965781585-project Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 could not be found. Aug 30 00:01:54.064738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '3cb1c11e-eeb2-4b6d-94e1-4b421346f429'} Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 could not be found. Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:01:54.065499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 could not be found. Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 could not be found. Aug 30 00:01:54.066748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:01:54.068454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] Returning 404 to user: Instance 3cb1c11e-eeb2-4b6d-94e1-4b421346f429 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:01:54.068867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d2df0679-0c09-4609-a7ad-24e44ce69c5b tempest-VolumesActionsTest-965781585 tempest-VolumesActionsTest-965781585-project] 10.222.0.60 "GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429" status: 404 len: 111 microversion: 2.1 time: 0.047290 Aug 30 00:01:54.069635 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 206/388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:54 2022] GET /compute/v2.1/servers/3cb1c11e-eeb2-4b6d-94e1-4b421346f429 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:54.594738 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:54.595692 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:54.605579 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.607813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.608501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.609457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.610130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.610773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.831003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:54.843549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:54.845212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:54.846779 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-abf694ca-bd13-4049-997f-f8ac90fbaabb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.256696 Aug 30 00:01:54.852332 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 183/389] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:54 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:54.855516 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:54.856656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:54.866914 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.875345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.875345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.875615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:54.875822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.876044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:54.876153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.876153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.878435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.879375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.880515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:54.881488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:54.882222 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:54.882892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:55.018753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:55.034078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-daeb58a0-09c4-43b6-81e0-f74cb5dd0c45 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1296 microversion: 2.1 time: 0.171409 Aug 30 00:01:55.035212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 184/390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:54 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:55.070625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:55.084599 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fa6044e9-87ab-43cf-8c90-45f23cd4ecaa tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.235040 Aug 30 00:01:55.085184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 207/391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:54 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:55.874218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:55.874858 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:55.880785 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:55.881269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:55.881694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:55.882378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:55.882857 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:55.883308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:56.018209 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:56.027401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:56.028852 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:56.030008 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6a7cbb64-7bfd-489b-ab9c-a1db8895938f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.159860 Aug 30 00:01:56.030586 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 185/392] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:55 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:56.060236 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:56.061603 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:56.073839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:56.073839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:56.073839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:56.073839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:56.074278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:56.074278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:56.107558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:56.108168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:56.114053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:56.114563 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:56.115003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:56.115700 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:56.116148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:56.116565 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:56.135753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:56.143448 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-398fe923-517f-44ea-ae74-4c77d2357f15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1314 microversion: 2.1 time: 0.087511 Aug 30 00:01:56.144022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 208/393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:56 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1314 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:56.309657 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:56.319430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-80bc4825-c790-44e8-8b38-e1ad2733af6b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.216300 Aug 30 00:01:56.335488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 186/394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:56 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:57.053665 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:57.054363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:57.062091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.062852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.063175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.063946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.064506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.065144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.164611 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:57.165251 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:57.171971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.172459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.172898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.173700 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.174067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.174506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.209944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:57.223164 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:57.224599 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:57.225800 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6ea2f310-3cd5-45d8-a9d2-33104ef3ac36 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.176395 Aug 30 00:01:57.226297 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 209/395] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:57 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:57.322488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:57.330108 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2f30b9ac-b042-43a9-a614-df6326e5b8f2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.169400 Aug 30 00:01:57.330691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 187/396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:57 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:57.349722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:57.350366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:57.360220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.360716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.361148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.361855 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:57.362308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:57.362767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:57.507947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:57.516622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fca36395-053c-40d8-b3d5-c1172f8866c7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.171029 Aug 30 00:01:57.517213 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 210/397] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:57 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:58.249751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:58.250343 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:58.259218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.260664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.262285 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.263787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.264452 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.265012 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.353985 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:58.354682 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:58.362945 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.364067 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.364885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.365683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.366215 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.366736 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.495687 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:58.512340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:58.517391 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:58.518681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:58.520229 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f0b2cf4a-bd96-49f0-9100-acc64ab118f0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.274493 Aug 30 00:01:58.524911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 188/398] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:58 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:58.529418 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d69dd49d-7afc-4bee-bc75-b636c1913ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.179642 Aug 30 00:01:58.530335 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 211/399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:58 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:58.538567 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:58.539268 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:58.545821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.546379 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.546911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.547747 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.548373 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.548791 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.742730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:58.751582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b137bc96-4b93-4229-8a07-7a837dc99fde tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.217398 Aug 30 00:01:58.752160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 189/400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:58 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:58.897747 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-dd51af95-c495-4376-be28-8e16b428b998 req-19030b9f-e9ad-48e9-9e45-de889a0a6426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd", "tag": "95eb0348-4d8c-4314-b169-75e6e905f723"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:58.908669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-dd51af95-c495-4376-be28-8e16b428b998 req-19030b9f-e9ad-48e9-9e45-de889a0a6426 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:58.909520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-dd51af95-c495-4376-be28-8e16b428b998 req-19030b9f-e9ad-48e9-9e45-de889a0a6426 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:58.910303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-dd51af95-c495-4376-be28-8e16b428b998 req-19030b9f-e9ad-48e9-9e45-de889a0a6426 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:58.927020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-dd51af95-c495-4376-be28-8e16b428b998 req-19030b9f-e9ad-48e9-9e45-de889a0a6426 service nova] Creating event network-changed:95eb0348-4d8c-4314-b169-75e6e905f723 for instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd on hv-cinder-85427 Aug 30 00:01:58.932077 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-dd51af95-c495-4376-be28-8e16b428b998 req-19030b9f-e9ad-48e9-9e45-de889a0a6426 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037956 Aug 30 00:01:58.932674 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 212/401] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:59.552140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:59.552747 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:59.560176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:59.560778 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:59.561337 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:59.561628 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:59.562275 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:59.562394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:59.562973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:59.563491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:59.574390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:59.574824 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:59.575259 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:59.575961 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:59.576412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:59.576946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:59.713881 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:59.721784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a93ad2e9-eee2-473a-8c47-06de66dce42e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.168844 Aug 30 00:01:59.722357 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 213/402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:59 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:59.762837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:59.778888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:59.778888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:59.779411 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b74b0b90-a0d1-4c0b-b9d2-2edbc5018436 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1739 microversion: 2.20 time: 0.231178 Aug 30 00:01:59.779716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:59.779970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 190/403] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:01:59 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:01:59.780372 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:59.786454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:59.786954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:59.787380 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:59.788425 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:59.788876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:59.789295 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:59.925878 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:59.935432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-732a0f44-0f88-4804-8ca1-79d4cfd0956e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.164932 Aug 30 00:01:59.936319 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 214/404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:59 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:00.741305 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:00.741909 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:00.748129 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.748809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.749239 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.749923 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.750372 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.750832 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.801123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:00.801791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:00.808410 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.808829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.809431 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.810134 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.810615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.811036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.904362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:00.914162 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1ebf34aa-6f23-456e-b409-407f65c6f84d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.176372 Aug 30 00:02:00.915152 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 191/405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:00 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:00.959819 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:00.960697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:00.972202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.972892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.973442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.974282 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:00.974873 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:00.975352 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:00.986124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:00.995850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:00.997499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:00.998909 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4181db4e-7ebd-4cd8-a28d-a23a26a12087 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1721 microversion: 2.20 time: 0.201636 Aug 30 00:02:00.999666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 215/406] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:00 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:02:01.026018 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.170338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:01.187587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-60835969-98ca-4840-935a-16939a00b2df tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.228174 Aug 30 00:02:01.187587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 192/407] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:00 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:01.941757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:01.942387 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:01.950662 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:01.951308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:01.956212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:01.956212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:01.956212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:01.956212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:02.031239 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:02.032313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:02.039998 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:02.040671 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:02.041433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:02.042243 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:02.042794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:02.043218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:02.109003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:02.121201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5a2105ce-557f-4c17-96fe-db0c0ce1d1a6 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.183474 Aug 30 00:02:02.122356 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 216/408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:01 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:02.203174 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:02.203758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:02.210135 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:02.210677 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:02.211102 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:02.211810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:02.212303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:02.212876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:02.221192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:02.230019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:02.231523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:02.232674 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-360e84a0-c317-416e-9e87-e7bb08e9b26b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1721 microversion: 2.20 time: 0.212335 Aug 30 00:02:02.242784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 193/409] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:02 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:02:02.370417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:02.379778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-54c05f36-adec-47c5-88f6-f90d6e576eb3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.179798 Aug 30 00:02:02.379778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 217/410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:02 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:03.152131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:03.152131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:03.159740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.159740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=12 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.160407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:03.160911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:03.161753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.162940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:03.172282 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:03.172806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.263056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:03.263700 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:03.272741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:03.285480 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:03.285480 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.285480 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:03.285480 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:03.286435 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.342504 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:03.349569 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3ed62778-43c1-447a-b647-ffcf0c8a4d68 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.208216 Aug 30 00:02:03.350404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 194/411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:03 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:03.411584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:03.411584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:03.411584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:03.411584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:03.412114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.412114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:03.412114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:03.412114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:03.453085 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:03.461918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:03.469500 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:03.469500 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1ddbcb0b-7785-49ad-9324-1e5404a8f8bb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1721 microversion: 2.20 time: 0.208152 Aug 30 00:02:03.469500 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 218/412] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:03 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:03.568021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:03.577022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-43b90407-b359-4b94-962b-a29d86568920 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.180357 Aug 30 00:02:03.578119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 195/413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:03 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:04.072306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-1723d303-e393-4fdf-929c-27f43e7f29bf req-55efd2f0-6183-4cbf-94e2-51e44d450779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa3cd3e-c701-4851-a613-4c89ea690072", "name": "network-vif-unplugged", "status": "completed", "tag": "7aa950fd-42ef-47f2-90db-cffca1a6595c"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:04.087397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-1723d303-e393-4fdf-929c-27f43e7f29bf req-55efd2f0-6183-4cbf-94e2-51e44d450779 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.093148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-1723d303-e393-4fdf-929c-27f43e7f29bf req-55efd2f0-6183-4cbf-94e2-51e44d450779 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.093148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-1723d303-e393-4fdf-929c-27f43e7f29bf req-55efd2f0-6183-4cbf-94e2-51e44d450779 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.100979 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-1723d303-e393-4fdf-929c-27f43e7f29bf req-55efd2f0-6183-4cbf-94e2-51e44d450779 service nova] Creating event network-vif-unplugged:7aa950fd-42ef-47f2-90db-cffca1a6595c for instance bfa3cd3e-c701-4851-a613-4c89ea690072 on hv-cinder-85427 Aug 30 00:02:04.106118 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-1723d303-e393-4fdf-929c-27f43e7f29bf req-55efd2f0-6183-4cbf-94e2-51e44d450779 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039090 Aug 30 00:02:04.106728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 219/414] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:04.375544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:04.377897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:04.387357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.388111 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.389173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.390584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.391339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.392308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.492873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:04.497133 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:04.510283 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.511493 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.512046 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.513722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.514694 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.515639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.576457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:04.588704 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d1701bbd-aca8-4a42-a9b2-f57be03092f3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.221963 Aug 30 00:02:04.590293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 196/415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:04 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:04.611315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:04.612268 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:04.625929 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.626748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.627359 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.628249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:04.628862 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:04.630401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:04.727939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:04.740612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:04.740612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:04.741478 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7d3e9863-0cbd-49e0-8cfc-b2643d9d4003 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1721 microversion: 2.20 time: 0.257047 Aug 30 00:02:04.742293 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 220/416] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:04 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:04.818272 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:04.828502 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1784cf95-4f2f-490c-a2ad-b4aae97cefd5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.233467 Aug 30 00:02:04.830447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 197/417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:04 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:05.611079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:05.613125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:05.620299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.620880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.621378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.622202 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.622762 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.623256 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.765990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:05.767802 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:05.776520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.777007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.777444 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.778150 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.778638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.780048 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.790687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:05.799267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-30376232-b3df-4cf2-beb1-75987cdaa502 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.192009 Aug 30 00:02:05.813049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 221/418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:05 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:05.856246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:05.856858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:05.863456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.864301 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.864745 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.865483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.866276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.866796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.890168 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.979075 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:05.989960 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:05.991934 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:05.993672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-21a11913-a536-4dfa-beaa-3bf07dab1f19 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1721 microversion: 2.20 time: 0.232023 Aug 30 00:02:06.011448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 198/419] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:05 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:02:06.025721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:06.035430 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-28986518-ca9b-4af6-870f-1adf83909b61 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.183532 Aug 30 00:02:06.036236 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 222/420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:05 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:06.821013 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:06.822656 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:06.830447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:06.831177 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:06.831693 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:06.832632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:06.833253 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:06.833671 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:06.984491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:06.992745 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3f938dd9-f71b-4f63-ae64-58b3bbabfa48 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.175747 Aug 30 00:02:06.994437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 199/421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:06 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:07.030078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:07.032086 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:07.043769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.044326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.044962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.045856 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.046444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.047041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.061737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:07.062856 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:07.072323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.072915 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.073426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.074987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.075658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.076230 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.246162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:07.249055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:07.263958 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:07.265418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-49a1dc83-4121-4499-a532-fefaa55b7e40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.208455 Aug 30 00:02:07.265648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:07.266164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 200/422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:07 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:07.266956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f13902b7-6293-4900-8da7-4fe9f69841ac tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1721 microversion: 2.20 time: 0.247787 Aug 30 00:02:07.267790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 223/423] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:07 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:08.022261 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:08.023840 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:08.030284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.031106 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.031919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.032826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.033345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.033837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.175769 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:08.184585 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0f07b92c-a097-46c6-974b-60ab989b56dc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.166021 Aug 30 00:02:08.185182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 201/424] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:08 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:08.287629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:08.288251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:08.295427 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:08.296026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:08.308148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.308148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.308148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.308148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.308553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.308553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.315692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.316189 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.316631 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.317322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.317768 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.318184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.481758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:08.491304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:08.492926 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:08.494161 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b3d22919-dc02-4e02-8b53-a8189f81c307 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1721 microversion: 2.20 time: 0.202506 Aug 30 00:02:08.506518 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 202/425] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:08 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:08.543461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:08.556356 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c714e893-c337-4401-a567-6d69567292f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.272113 Aug 30 00:02:08.557139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 224/426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:08 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:09.206802 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:09.207370 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:09.214741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.215227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.215659 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.216362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.216810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.217228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.360739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:09.388401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e539b53e-39ff-471b-ae30-ab7b2063d69e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.185043 Aug 30 00:02:09.405320 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 203/427] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:09 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:09.519687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:09.520393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:09.526887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.527440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.527957 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.528724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.529240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.529744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.582271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:09.583451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:09.595011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.596004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.597420 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.598681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.599317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.600408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.707896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:09.717491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:09.719619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:09.721086 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3cc423d5-bfc2-4cbb-8258-102bbc4966de tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1724 microversion: 2.20 time: 0.205451 Aug 30 00:02:09.736598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 225/428] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:09 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:09.745708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f87b8426-551d-4aa8-bfb3-869562578c42"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:09.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:09.786835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.788991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.789715 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.791219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.792078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.794506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.797905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:09.810014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-57f1942d-f633-4e91-8d88-390ee06a31f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.232793 Aug 30 00:02:09.810967 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 204/429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:09 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:10.429998 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:10.433639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:10.442093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.442912 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.443678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.444641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.445085 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.445496 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.637897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:10.646540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7a2a6a55-5e55-437f-a989-5583115ce75e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.222024 Aug 30 00:02:10.650394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 205/430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:10 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:10.767047 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4c6b585d-f370-43eb-903a-9fc416150040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.025651 Aug 30 00:02:10.773519 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 226/431] 10.222.0.60 () {62 vars in 1364 bytes} [Tue Aug 30 00:02:09 2022] POST /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments => generated 188 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:02:10.832725 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:10.833401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:10.848624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.849149 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.849581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.850282 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.850757 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.851382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.937080 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:10.937594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:10.943870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.944361 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.944798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.945504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.945955 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.946980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.993495 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127769) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 00:02:11.008167 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:11.027260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:11.037317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-51eb8ea9-a2c0-45d3-8c5b-38576c7ae585 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.209092 Aug 30 00:02:11.050977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 206/432] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:10 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:11.280773 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e248f7a8-9326-41f4-a0e6-7af8ed68a7fd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/action" status: 202 len: 0 microversion: 2.20 time: 0.347580 Aug 30 00:02:11.281605 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 227/433] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 30 00:02:10 2022] POST /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:11.293030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:11.295314 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:11.311098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.311592 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.312028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.312746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.313187 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.319251 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.497721 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:11.508038 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:11.510699 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:11.512071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-66f2b863-0ef4-40e8-9740-393dfe817fcc tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1750 microversion: 2.20 time: 0.226327 Aug 30 00:02:11.527228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 207/434] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:11 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:02:11.670417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:11.671412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:11.678186 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.678999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.679611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.681123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.681913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.682515 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.827037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:11.836723 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c6e3e95c-3cdc-4a7a-853c-38ec02dbd06b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.171497 Aug 30 00:02:11.837655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 228/435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:11 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:12.060927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:12.061587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:12.069809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.070542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.071705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:12.072449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.073073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.073670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:12.221479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:12.232638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-484581b0-9e06-4854-9b64-bd045a87aa0c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.176704 Aug 30 00:02:12.233610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 208/436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:12 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:12.540760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:12.542213 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:12.552863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.552863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.552863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:12.554646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.554646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.554646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:12.703536 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:12.715352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:12.718273 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:12.719781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-184db7b9-0d2f-47b4-9e26-9eaf2e7f51cd tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1750 microversion: 2.20 time: 0.184745 Aug 30 00:02:12.720852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 229/437] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:12 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:12.864104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:12.864682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:12.871856 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.872793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.873412 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:12.874264 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:12.874887 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:12.875503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:12.880649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:13.256783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:13.257966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:13.273050 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:13.276504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:13.277094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:13.278446 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:13.282430 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:13.282996 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:13.321788 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:13.331917 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-25453cea-aade-499e-b6d4-c54fc46979fe tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.475983 Aug 30 00:02:13.333156 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 209/438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:12 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:13.338566 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-d225a3c6-7e20-40f5-8883-ca8b0f4f8c1e req-9002cc32-489f-4fb0-925b-1f505c6ec9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd", "name": "network-vif-plugged", "status": "completed", "tag": "95eb0348-4d8c-4314-b169-75e6e905f723"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:13.350724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-d225a3c6-7e20-40f5-8883-ca8b0f4f8c1e req-9002cc32-489f-4fb0-925b-1f505c6ec9d2 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:13.351503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-d225a3c6-7e20-40f5-8883-ca8b0f4f8c1e req-9002cc32-489f-4fb0-925b-1f505c6ec9d2 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:13.352133 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-d225a3c6-7e20-40f5-8883-ca8b0f4f8c1e req-9002cc32-489f-4fb0-925b-1f505c6ec9d2 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:13.365449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-d225a3c6-7e20-40f5-8883-ca8b0f4f8c1e req-9002cc32-489f-4fb0-925b-1f505c6ec9d2 service nova] Creating event network-vif-plugged:95eb0348-4d8c-4314-b169-75e6e905f723 for instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd on hv-cinder-85427 Aug 30 00:02:13.377036 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-d225a3c6-7e20-40f5-8883-ca8b0f4f8c1e req-9002cc32-489f-4fb0-925b-1f505c6ec9d2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038825 Aug 30 00:02:13.377854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 210/439] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:13.498839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:13.510564 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-07db811b-9e11-4352-9ae5-514ba3814b3a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.258422 Aug 30 00:02:13.511370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 230/440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:13 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:13.751950 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:13.752592 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:13.762151 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:13.771900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:13.772396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:13.773141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:13.773610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:13.778510 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.056984 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:14.069610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:14.073574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:14.086997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6fe7fc5c-9ebd-47b9-9733-fa749c827c6b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1752 microversion: 2.20 time: 0.330855 Aug 30 00:02:14.086997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 211/441] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:13 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1752 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:14.353051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:14.354407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:14.364283 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:14.368081 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:14.368529 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.369300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:14.369781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:14.370216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.532973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:14.533803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:14.543323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:14.543323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:14.546194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.548809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:14.550369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:14.551799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:14.553905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:14.600468 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9d12c4e9-ac58-483c-82ca-8660b4d31a91 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.248376 Aug 30 00:02:14.601151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 231/442] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:14 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:14.747707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:14.757907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-aef24b82-33a8-4a96-974f-18a6e6774863 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.228700 Aug 30 00:02:14.758885 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 212/443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:14 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:15.104701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:15.105199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:15.111474 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.112241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.117520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.117520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.117520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.117520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.273736 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:15.283551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:15.285381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:15.286956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-003ca975-7b7b-4135-a08c-e1a75885b703 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1752 microversion: 2.20 time: 0.186813 Aug 30 00:02:15.299103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 232/444] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:15 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1752 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:15.632849 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:15.634515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:15.642367 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.643105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.643929 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.645483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.646754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.647835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.810933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:15.810933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:15.810933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.810933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.811716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.811716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:15.811716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:15.811716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:15.837554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:15.846384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-80ac5955-87c4-42ca-ba88-6d1ce83ad956 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1369 microversion: 2.1 time: 0.217818 Aug 30 00:02:15.847161 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 213/445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:15 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:15.989994 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:16.002781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-43c47fa1-a97b-494e-9ba0-c80da88009ff tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.225551 Aug 30 00:02:16.003357 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 233/446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:15 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:16.312090 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:16.312820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:16.329536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.330129 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.330758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:16.337441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.338461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.339245 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:16.611639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:16.627773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:16.629287 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:16.630510 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-87bf6bc9-c651-49f9-a923-1048618d9051 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.322996 Aug 30 00:02:16.646912 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 214/447] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:16 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:16.868414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:16.869111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:16.879987 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.880479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.880913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:16.881609 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:16.882056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:16.882615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:17.028728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:17.029463 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:17.035609 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:17.036590 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:17.037182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:17.038866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:17.040200 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:17.040859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:17.041203 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:17.049062 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e7428e7a-ac81-4c52-a411-f512f7ce00f4 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1562 microversion: 2.1 time: 0.184539 Aug 30 00:02:17.049664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 234/448] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:16 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:17.074725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:17.075191 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:17.081340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:17.081735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:17.082166 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:17.082897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:17.083347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:17.083768 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:17.088201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:17.163477 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-744106f6-8781-40aa-ba39-072c53c219fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092677 Aug 30 00:02:17.164174 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 235/449] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:02:17 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:02:17.387999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:17.397005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5972348a-e74d-4394-9519-14176a664a34 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.375672 Aug 30 00:02:17.410685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 215/450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:17 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:17.653669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:17.654277 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:17.661095 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:17.661938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:17.662601 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:17.663655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:17.664264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:17.664800 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:17.812796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:17.823012 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:17.824543 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:17.825915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-66ced869-a153-4b20-86a6-3353917a6c45 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.176041 Aug 30 00:02:17.826707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 236/451] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:17 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:18.420628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:18.421993 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:18.432946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:18.433717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:18.434459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:18.435381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:18.435988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:18.436596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:18.854000 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:18.854648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:18.870886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:18.871366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:18.871854 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:18.872690 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:18.873017 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:18.873486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:18.914228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:18.925400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-553e7f19-54b2-470a-8d33-e959567a1602 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.506055 Aug 30 00:02:18.935021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 216/452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:18 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:19.095073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-9b2699f9-4013-4b8c-8a16-4cd7e9b7ff44 req-97685318-02b6-4b01-813f-502e16cb3ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd", "tag": "95eb0348-4d8c-4314-b169-75e6e905f723"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:19.112535 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:19.114771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9b2699f9-4013-4b8c-8a16-4cd7e9b7ff44 req-97685318-02b6-4b01-813f-502e16cb3ea7 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:19.115294 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9b2699f9-4013-4b8c-8a16-4cd7e9b7ff44 req-97685318-02b6-4b01-813f-502e16cb3ea7 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:19.115720 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9b2699f9-4013-4b8c-8a16-4cd7e9b7ff44 req-97685318-02b6-4b01-813f-502e16cb3ea7 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:19.122387 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:19.123922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:19.125141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-461d7ca8-1c5e-4eb1-b391-3287597abc25 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.275693 Aug 30 00:02:19.125702 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 237/453] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:18 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:19.132360 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-9b2699f9-4013-4b8c-8a16-4cd7e9b7ff44 req-97685318-02b6-4b01-813f-502e16cb3ea7 service nova] Creating event network-changed:95eb0348-4d8c-4314-b169-75e6e905f723 for instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd on hv-cinder-85427 Aug 30 00:02:19.138656 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-9b2699f9-4013-4b8c-8a16-4cd7e9b7ff44 req-97685318-02b6-4b01-813f-502e16cb3ea7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048602 Aug 30 00:02:19.140127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 217/454] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:02:19.955835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:19.957183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:19.971550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:19.971550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:19.971550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:19.971550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:19.972251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:19.972251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:20.126172 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:20.135735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-65cb5376-e80f-4712-909e-6f40a02cd8d9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1723 microversion: 2.1 time: 0.188331 Aug 30 00:02:20.136425 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 238/455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:19 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:20.152616 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:20.153309 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:20.159713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:20.160180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:20.160603 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:20.161290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:20.161730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:20.162375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:20.315578 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:20.326167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:20.331170 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:20.331170 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0e1d269b-204b-4b35-a667-ad614c788823 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.181657 Aug 30 00:02:20.331170 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 218/456] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:20 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:21.160052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:21.160828 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:21.169406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:21.171216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:21.171939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:21.172948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:21.173776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:21.174486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:21.332037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:21.341273 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f9d9d58f-ba36-4ec4-8ca2-57ba13c2b721 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1700 microversion: 2.1 time: 0.186455 Aug 30 00:02:21.341864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 239/457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:21 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1700 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:21.356206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:21.357517 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:21.363504 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.365466 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:21.366205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:21.368934 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e77cad86-cde1-4ac1-98eb-3a4df8833df2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:21.369118 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:21.369794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:21.370249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:21.370708 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:21.377059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e77cad86-cde1-4ac1-98eb-3a4df8833df2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:21.377968 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e77cad86-cde1-4ac1-98eb-3a4df8833df2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:21.378859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e77cad86-cde1-4ac1-98eb-3a4df8833df2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:21.451837 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e77cad86-cde1-4ac1-98eb-3a4df8833df2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Going to try to start instance {{(pid=127769) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 00:02:21.589947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:21.606843 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:21.609574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:21.611324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-269df296-6100-47a1-8366-8a19db54c1fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.260748 Aug 30 00:02:21.628332 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 219/458] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:21 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:21.632959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e77cad86-cde1-4ac1-98eb-3a4df8833df2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.265869 Aug 30 00:02:21.632959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 240/459] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:02:21 2022] POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:02:21.644726 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:21.647146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:21.667104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:21.667966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:21.668780 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:21.669699 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:21.670335 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:21.670886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:21.870907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:21.880879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c92b85b1-0e46-4483-8d4a-d638f61d945f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.243661 Aug 30 00:02:21.882189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 220/460] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:21 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:22.636518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:22.638441 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:22.644818 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:22.645304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:22.645899 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:22.646560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:22.647010 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:22.647609 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:22.885183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:22.897913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:22.900143 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:22.901836 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b84d54a0-707c-451a-b18e-d95cfb08a732 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.270894 Aug 30 00:02:22.904455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 241/461] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:22 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:22.904577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:22.905148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:22.911755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:22.912484 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:22.913119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:22.914009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:22.917879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:22.918551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:23.107105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:23.115307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f30b03cf-6635-4d00-82f6-bc69cd810c40 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.215741 Aug 30 00:02:23.115878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 221/462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:22 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:23.925511 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:23.926365 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:23.935924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:23.936487 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:23.936858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:23.937646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:23.938195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:23.938698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:24.114158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:24.123279 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:24.124743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:24.126175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e029d92a-3843-4b9b-a373-9d92660fa804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.204924 Aug 30 00:02:24.127280 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 242/463] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:23 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:02:24.160235 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:24.160979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:24.167449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:24.167940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:24.168380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:24.169141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:24.169827 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:24.170311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:24.321377 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:24.332778 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5ee119bc-e6f4-4a8a-aa32-e1038e32657a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.189004 Aug 30 00:02:24.334055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 222/464] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:24 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:25.156312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:25.156932 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:25.168171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:25.168619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:25.169056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:25.169885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:25.170214 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:25.170675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:25.358616 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:25.362275 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:25.365168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:25.374340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:25.379331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:25.379826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:25.380261 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:25.380965 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:25.381417 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:25.381839 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:25.385409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:25.386898 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2cb43927-8dc3-414c-ad13-16ffe3251904 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.234417 Aug 30 00:02:25.392809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 243/465] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:25 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:25.583078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:25.594705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8729178e-c545-4b7d-95d5-38a268a33bf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.242714 Aug 30 00:02:25.608762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 223/466] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:25 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:26.413320 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:26.414344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:26.422117 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:26.426489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:26.426489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:26.426489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:26.426489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:26.426859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:26.577147 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:26.587023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:26.588892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:26.590306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-77197c94-c1a8-4c80-b3ea-38fc59f5ff69 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.180994 Aug 30 00:02:26.590891 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 244/467] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:26 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:26.618072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:26.619598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:26.625847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:26.631369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:26.631369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:26.631369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:26.631369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:26.631738 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:26.765695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:26.774096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d0d8783d-7ec2-4547-82b8-1ac0c58a162a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.161296 Aug 30 00:02:26.774719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 224/468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:26 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:27.614033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:27.614642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:27.621588 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:27.622378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:27.622538 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:27.623189 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:27.623637 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:27.624065 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:27.753231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:27.762005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:27.763479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:27.764698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-22590b52-1f3e-4bd4-a419-ce9a94bc6ec4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.154711 Aug 30 00:02:27.765278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 245/469] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:27 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:27.795921 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:27.796521 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:27.804864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:27.809897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:27.809897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:27.809897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:27.809897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:27.810283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:28.040405 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:28.043383 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:28.044342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:28.050215 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8c1737e8-c849-43e9-9544-fd80e312064a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.258018 Aug 30 00:02:28.066225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:28.066225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:28.066503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 225/470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:27 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:28.066596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:28.066596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:28.066596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:28.066596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:28.076946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-27ec5b64-ecdb-48f2-b92f-2035a5a6b4ea tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/ips" status: 200 len: 149 microversion: 2.1 time: 0.038099 Aug 30 00:02:28.077525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 246/471] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:02:28 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:02:28.787601 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:28.788028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:28.793977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:28.794461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:28.794927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:28.795617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:28.796067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:28.796683 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:28.931459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:28.940126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:28.941578 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:28.942762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-aa870ed1-6edf-4833-b178-8c04cc59665f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.159248 Aug 30 00:02:28.943319 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 226/472] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:28 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:29.075321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:29.075993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:29.082380 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:29.082910 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:29.083344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:29.084065 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:29.084518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:29.084944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:29.213059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:29.221244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-818f2b4d-c456-4447-af71-81774432347c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.150552 Aug 30 00:02:29.221803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 247/473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:29 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:29.966354 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:29.966988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:29.972901 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:29.973377 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:29.973806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:29.974510 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:29.974963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:29.975407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:29.979319 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:30.102076 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:30.111231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:30.112691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:30.113860 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7962166d-4680-46e5-a602-fd34f54aa6c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.152102 Aug 30 00:02:30.114423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 227/474] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:29 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:30.242310 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:30.242930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:30.249831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:30.250306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:30.250819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:30.251529 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:30.251975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:30.252395 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:30.383069 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:30.392054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dce22a28-5528-4820-a904-38e80f2c8204 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.153518 Aug 30 00:02:30.392622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 248/475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:30 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:31.138810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:31.139434 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:31.145365 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.145963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.146378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:31.147148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.147592 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.148010 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:31.274423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:31.282939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:31.284381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:31.285520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d11e0bca-12b4-451f-a5a7-14b4e4b9a07a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.152344 Aug 30 00:02:31.286073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 228/476] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:31 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:31.412958 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:31.413592 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:31.420703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.421186 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.421621 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:31.422307 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.422796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.423226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:31.551705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:31.560586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-501856e5-d23c-473e-a340-6e8f6327014a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1709 microversion: 2.1 time: 0.151460 Aug 30 00:02:31.564216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 249/477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:31 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:31.986166 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96d2cc13-2770-411e-82fe-2f79061706d2"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:31.988593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:31.995112 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.995588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.996014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:31.996688 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:31.997127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:31.997563 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:32.308906 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:32.309508 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:32.315489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:32.315972 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:32.316406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:32.317088 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:32.317571 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:32.317963 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:32.461564 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:32.470404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:32.471960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:32.473126 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-575e6d48-dcac-4499-aa0d-831321db124e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.168836 Aug 30 00:02:32.473684 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 250/478] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:32 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:32.581863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:32.582520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:32.588893 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:32.589373 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:32.589809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:32.590517 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:32.590971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:32.591396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:32.609535 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:32.718941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:32.726933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-75cb9c6a-e3aa-46c9-8224-e72437b1bf54 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1713 microversion: 2.1 time: 0.148905 Aug 30 00:02:32.733925 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 251/479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:32 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1713 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:32.964744 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a2ff1dcc-bee7-426a-a6ab-c7b7b64e4a4a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.982091 Aug 30 00:02:32.965378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 229/480] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:02:31 2022] POST /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:33.498131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:33.498763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:33.506015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:33.506519 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:33.506959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:33.507647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:33.508099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:33.508789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:33.636250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:33.644816 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:33.646263 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:33.647439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e6eb38f6-96fb-43f8-8190-a4ded86999e9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.154116 Aug 30 00:02:33.648013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 252/481] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:33 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:34.670944 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:34.671639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:34.677681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:34.678159 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:34.678913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:34.679312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:34.679751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:34.680168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:34.819006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:34.824686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:34.826165 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:34.827404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3cc9fe80-f493-4ddd-a9ec-2f0d31f5801e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.161386 Aug 30 00:02:34.828164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 230/482] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:34 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:35.850769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:35.851371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:35.858234 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:35.858752 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:35.859186 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:35.859870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:35.860349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:35.860772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:35.994940 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:36.009796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:36.009796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:36.009796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d05cabed-d624-4391-a663-14a3b540cc4a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.160414 Aug 30 00:02:36.014804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 253/483] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:35 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:37.030267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:37.032185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:37.037785 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:37.038385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:37.038795 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:37.039488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:37.040061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:37.040483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:37.193180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:37.208728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:37.210976 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:37.213607 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-63a657ec-2b71-4222-8f84-04a0ad7c8932 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.187412 Aug 30 00:02:37.216340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 231/484] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:37 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:02:37.255490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-06969821-28bd-4db7-949b-d97d70e5097c req-98423605-2635-4572-94ff-0f4f7f33f209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa3cd3e-c701-4851-a613-4c89ea690072", "name": "network-vif-plugged", "status": "completed", "tag": "7aa950fd-42ef-47f2-90db-cffca1a6595c"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:37.268429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-06969821-28bd-4db7-949b-d97d70e5097c req-98423605-2635-4572-94ff-0f4f7f33f209 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:37.269240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-06969821-28bd-4db7-949b-d97d70e5097c req-98423605-2635-4572-94ff-0f4f7f33f209 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:37.269883 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-06969821-28bd-4db7-949b-d97d70e5097c req-98423605-2635-4572-94ff-0f4f7f33f209 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:37.285136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-06969821-28bd-4db7-949b-d97d70e5097c req-98423605-2635-4572-94ff-0f4f7f33f209 service nova] Creating event network-vif-plugged:7aa950fd-42ef-47f2-90db-cffca1a6595c for instance bfa3cd3e-c701-4851-a613-4c89ea690072 on hv-cinder-85427 Aug 30 00:02:37.290980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-06969821-28bd-4db7-949b-d97d70e5097c req-98423605-2635-4572-94ff-0f4f7f33f209 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039740 Aug 30 00:02:37.291584 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 254/485] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:38.238731 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:38.239338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:38.245970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:38.246437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:38.246895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:38.247581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:38.248027 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:38.248442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:38.382592 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:38.393502 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:38.394986 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:38.396152 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2025c7c9-318c-4d37-8b1c-1e9357a46971 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.161410 Aug 30 00:02:38.397025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 232/486] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:38 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:39.421403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:39.425091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:39.430825 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:39.431317 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:39.431756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:39.432467 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:39.433460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:39.433889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:39.697626 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:39.707005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:39.708696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:39.710005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ff59cf57-2cbc-4f87-8ccc-ffe1053c2ac0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.293688 Aug 30 00:02:39.719107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 255/487] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:39 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:40.737637 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:40.738260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:40.750285 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:40.755306 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:40.755517 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:40.760152 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:40.760639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:40.761108 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:40.970955 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:40.982509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:40.984279 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:40.985589 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3d843610-4bf1-4935-babc-d7dc79dfb8f4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1808 microversion: 2.20 time: 0.253857 Aug 30 00:02:40.986769 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 233/488] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:40 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:41.653441 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-48397ca8-f323-4b42-a3cf-7716da47a2fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: .version_select at 0x7f09bf2d9e50>, body: {"keypair": {"name": "tempest-keypair-482431715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF4YJiWtsoPgP6/3sqYROpcGTqpBTRRdL43tv3b8SZlCqu0we3521s2gyDGu13y9PbnQNDQObriVnVvl3SnPBIKF5S/JVk2YsGykcc6oFOBFzyZdJJpWOoJMqSRfMUsrw=="}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:41.668170 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=57 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:41.680304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-48397ca8-f323-4b42-a3cf-7716da47a2fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:02:41.686710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-48397ca8-f323-4b42-a3cf-7716da47a2fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:02:41.819809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-48397ca8-f323-4b42-a3cf-7716da47a2fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173628 Aug 30 00:02:41.820888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 256/489] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:02:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:42.010162 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:42.011601 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:42.025361 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:42.029078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:42.030881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:42.033892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:42.034424 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:42.034931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:42.402856 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:42.425615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:42.429202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:42.430843 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-67437e60-2e0e-4729-972d-5e0001eb832e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1795 microversion: 2.20 time: 0.425697 Aug 30 00:02:42.432132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 234/490] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:02:42 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1795 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:02:44.561063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1706836830", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb60052-2932-481b-a354-8ea27a27493d"}], "security_groups": [{"name": "tempest-securitygroup--1610314509"}], "key_name": "tempest-keypair-482431715", "user_data": "}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:44.681512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] validate_networks() for [('ffb60052-2932-481b-a354-8ea27a27493d', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:02:45.526770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:02:45.527397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:02:45.528118 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:02:45.528608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:02:45.531644 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:02:45.539136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:45.546066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:45.546936 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:45.547859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:45.548486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:45.549117 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:45.577839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:02:45.583955 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:02:45.597853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:02:45.600556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:02:45.818584 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-50a6f8cf-2a9a-4c51-a611-00c68e5eea06 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.264032 Aug 30 00:02:45.819255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 257/491] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:02:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:02:45.830374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d1a7576b-0e75-48f0-9d06-862901055083 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:45.831620 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d1a7576b-0e75-48f0-9d06-862901055083 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:45.905958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d1a7576b-0e75-48f0-9d06-862901055083 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:45.924761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d1a7576b-0e75-48f0-9d06-862901055083 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1241 microversion: 2.1 time: 0.096108 Aug 30 00:02:45.925605 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 235/492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:45 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:46.951148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:46.958676 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:46.962299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:46.962819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:46.963385 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:46.964663 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:46.964663 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:46.964995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:47.066998 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:47.079262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-507b1ac1-591e-4726-9bd8-aa9890383bc1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1245 microversion: 2.1 time: 0.136300 Aug 30 00:02:47.080428 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 258/493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:46 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1245 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:48.100764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:48.102041 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:48.110006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:48.110557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:48.110955 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:48.111647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:48.112089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:48.112772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:48.174963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:48.184767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a919e173-ac53-4a13-818d-16b180c2455b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1293 microversion: 2.1 time: 0.088139 Aug 30 00:02:48.186605 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 236/494] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:48 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:49.210188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:49.210869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:49.221584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:49.222511 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:49.223208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:49.224083 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:49.224687 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:49.225256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:49.393412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-59abba60-2985-4f1d-8814-d3ca49abeeae tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Action: 'create', calling method: .version_select at 0x7f09bf32edc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2137386977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDarZmpvTNScbwoTLiMalWR9Puszb36h9XMMLpaqxVD75GSMUqmjDuLUU5UgNHeWkM9LFH+TIb/VBQCsFNEWHH89cMNzegWdP7zwEgjY592fpcrn0is+FmCd3KlsPOZbXA=="}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:49.412820 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-59abba60-2985-4f1d-8814-d3ca49abeeae tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Getting quotas for project 1eba2c58985143d9980157003e964772. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:02:49.418775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-59abba60-2985-4f1d-8814-d3ca49abeeae tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Getting quotas for user c0bc0a546aa34f1797dcf042306a8213 and project 1eba2c58985143d9980157003e964772. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:02:49.505086 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-59abba60-2985-4f1d-8814-d3ca49abeeae tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.386204 Aug 30 00:02:49.507225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 259/495] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:02:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:49.510705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:49.520526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-93d4ccb6-504a-4af2-a1f9-b1fec7b9c08b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1367 microversion: 2.1 time: 0.314045 Aug 30 00:02:49.524321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 237/496] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:49 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:50.184712 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-fb0dcdbf-6c9b-4599-a6ad-b50445675ffc req-75016f0b-cc71-4a10-8ca9-d96f0d451515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2e61a5-53b5-471d-994c-e914bc29062c", "tag": "087fef68-7393-41cd-a884-a680fa6b6d62"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:50.195893 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-fb0dcdbf-6c9b-4599-a6ad-b50445675ffc req-75016f0b-cc71-4a10-8ca9-d96f0d451515 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:50.196644 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-fb0dcdbf-6c9b-4599-a6ad-b50445675ffc req-75016f0b-cc71-4a10-8ca9-d96f0d451515 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:50.197226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-fb0dcdbf-6c9b-4599-a6ad-b50445675ffc req-75016f0b-cc71-4a10-8ca9-d96f0d451515 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:50.214342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-fb0dcdbf-6c9b-4599-a6ad-b50445675ffc req-75016f0b-cc71-4a10-8ca9-d96f0d451515 service nova] Creating event network-changed:087fef68-7393-41cd-a884-a680fa6b6d62 for instance 7d2e61a5-53b5-471d-994c-e914bc29062c on hv-cinder-85427 Aug 30 00:02:50.220193 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-fb0dcdbf-6c9b-4599-a6ad-b50445675ffc req-75016f0b-cc71-4a10-8ca9-d96f0d451515 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040027 Aug 30 00:02:50.224490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 260/497] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:50.543372 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:50.544167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:50.551537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:50.552029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:50.552445 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:50.553139 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:50.556641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:50.556641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:51.016847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:51.032047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c52446ef-412c-4988-9349-5d9e448a298a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1367 microversion: 2.1 time: 0.494161 Aug 30 00:02:51.033221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 238/498] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:50 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:52.054063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:52.054789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:52.061959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:52.062520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:52.062964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:52.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:52.064120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:52.064548 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:52.204873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:52.212399 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-266729b4-3b95-4f75-9050-3da99798514c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1367 microversion: 2.1 time: 0.163172 Aug 30 00:02:52.212966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 261/499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:52 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:53.233006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:53.233602 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:53.236411 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=42 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.241368 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:53.241932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:53.242618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:53.243536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:53.244044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:53.244537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:53.393878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:53.403556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e6375690-79b1-421a-bb63-455258e68a2d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1367 microversion: 2.1 time: 0.174541 Aug 30 00:02:53.404126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 239/500] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:53 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:54.426166 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:54.426811 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:54.433429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:54.433913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:54.434344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:54.435079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:54.435533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:54.435959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:54.584612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:54.606079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e7e84ca5-9953-44cf-9dda-e918e55dddd2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1367 microversion: 2.1 time: 0.184163 Aug 30 00:02:54.607652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 262/501] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:54 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:55.360501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-f8351b6e-2e47-4cc8-a2e9-3d8e94ae96ec req-b6b7c983-bd86-441f-be8a-edc489af6ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2e61a5-53b5-471d-994c-e914bc29062c", "name": "network-vif-plugged", "status": "completed", "tag": "087fef68-7393-41cd-a884-a680fa6b6d62"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:55.372836 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f8351b6e-2e47-4cc8-a2e9-3d8e94ae96ec req-b6b7c983-bd86-441f-be8a-edc489af6ea6 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:55.373345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f8351b6e-2e47-4cc8-a2e9-3d8e94ae96ec req-b6b7c983-bd86-441f-be8a-edc489af6ea6 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:55.373771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f8351b6e-2e47-4cc8-a2e9-3d8e94ae96ec req-b6b7c983-bd86-441f-be8a-edc489af6ea6 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:55.385727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-f8351b6e-2e47-4cc8-a2e9-3d8e94ae96ec req-b6b7c983-bd86-441f-be8a-edc489af6ea6 service nova] Creating event network-vif-plugged:087fef68-7393-41cd-a884-a680fa6b6d62 for instance 7d2e61a5-53b5-471d-994c-e914bc29062c on hv-cinder-85427 Aug 30 00:02:55.391507 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-f8351b6e-2e47-4cc8-a2e9-3d8e94ae96ec req-b6b7c983-bd86-441f-be8a-edc489af6ea6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034892 Aug 30 00:02:55.392136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 240/502] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:55.629362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:55.631352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:55.636739 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:55.640693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:55.641188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:55.641622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:55.642391 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:55.642884 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:55.643353 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:55.780939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:55.789022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-14f730d2-2cbf-4a2f-9b84-f282bdba9220 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1367 microversion: 2.1 time: 0.164962 Aug 30 00:02:55.789708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 263/503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:55 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:56.855006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:56.855006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:56.855006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:56.855006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:56.855006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:56.856615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:56.856615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:56.856615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:56.856615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:56.977043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:56.984923 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0da7dde7-f69d-4b95-afa0-6c0064f75b27 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1367 microversion: 2.1 time: 0.178204 Aug 30 00:02:56.985527 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 241/504] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:56 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:58.006100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:58.006739 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:58.015407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:58.015918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:58.016488 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:58.017188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:58.017674 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:58.018097 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:58.169636 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:58.178024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-416502d3-9787-4573-901b-0bf264c378e7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1557 microversion: 2.1 time: 0.176326 Aug 30 00:02:58.178610 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 264/505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:58 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:58.204844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:58.205374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:58.214750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:58.215239 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:58.215664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:58.216362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:58.216834 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:58.217249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:58.308188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-31c08e86-604e-4bcb-839d-1385b45bc0a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107519 Aug 30 00:02:58.308883 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 242/506] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:02:58 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:59.322666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-bc0e05b9-9831-4870-852b-dfd02cf554a8 req-facbf244-b446-4077-9c32-be957e24a8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2e61a5-53b5-471d-994c-e914bc29062c", "tag": "087fef68-7393-41cd-a884-a680fa6b6d62"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:59.333114 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-bc0e05b9-9831-4870-852b-dfd02cf554a8 req-facbf244-b446-4077-9c32-be957e24a8ac service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:59.333590 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-bc0e05b9-9831-4870-852b-dfd02cf554a8 req-facbf244-b446-4077-9c32-be957e24a8ac service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:59.334731 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-bc0e05b9-9831-4870-852b-dfd02cf554a8 req-facbf244-b446-4077-9c32-be957e24a8ac service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:59.346162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-bc0e05b9-9831-4870-852b-dfd02cf554a8 req-facbf244-b446-4077-9c32-be957e24a8ac service nova] Creating event network-changed:087fef68-7393-41cd-a884-a680fa6b6d62 for instance 7d2e61a5-53b5-471d-994c-e914bc29062c on hv-cinder-85427 Aug 30 00:02:59.351175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-bc0e05b9-9831-4870-852b-dfd02cf554a8 req-facbf244-b446-4077-9c32-be957e24a8ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032468 Aug 30 00:02:59.351974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 265/507] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:06.244281 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27a95b92-c72a-4930-87b4-e48e03f46421"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:06.246610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:06.252665 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:06.253143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:06.253578 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:06.254267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:06.254739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:06.255162 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:06.257481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.826914 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cecc6235-7620-4937-ba39-1bee364df03a tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586665 Aug 30 00:03:06.827507 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 243/508] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:03:06 2022] POST /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:09.604706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=14 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.606508 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=5 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.607163 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=58 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.611827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1169915275", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2137386977", "security_groups": [{"name": "tempest-secgroup-smoke-1317925933"}], "networks": [{"uuid": "938e28ed-174a-4d3b-8445-5e6dfaf727f2"}], "block_device_mapping_v2": [{"uuid": "14526907-da0b-4936-8cf4-be60ada1feb1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:09.728494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] validate_networks() for [('938e28ed-174a-4d3b-8445-5e6dfaf727f2', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:03:10.121392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:03:10.121820 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:03:10.122292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:03:10.122737 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:03:10.123148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:03:10.132529 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:10.133262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:10.133694 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:10.134412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:10.134896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:10.135322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:10.153166 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Getting quotas for project 1eba2c58985143d9980157003e964772. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:03:10.157150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Getting quotas for user c0bc0a546aa34f1797dcf042306a8213 and project 1eba2c58985143d9980157003e964772. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:03:10.214819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:03:10.217058 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14526907-da0b-4936-8cf4-be60ada1feb1',volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:03:10.550776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b619e9ca-b03d-463f-badd-7abe95086b6e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.946832 Aug 30 00:03:10.551424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 266/509] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:03:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:03:10.563135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-288cec2a-f45f-4266-8cdb-f70f0e407f87 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:10.563830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-288cec2a-f45f-4266-8cdb-f70f0e407f87 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:10.618020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-288cec2a-f45f-4266-8cdb-f70f0e407f87 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:10.625670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-288cec2a-f45f-4266-8cdb-f70f0e407f87 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1089 microversion: 2.1 time: 0.067215 Aug 30 00:03:10.627145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 244/510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:10 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:11.646880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:11.647486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:11.653986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:11.654539 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:11.654989 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:11.655680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:11.656134 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:11.657201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:11.717481 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:11.725645 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-69b4aa86-167e-4008-89d6-aad7ce9043a8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1139 microversion: 2.1 time: 0.083205 Aug 30 00:03:11.729764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 267/511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:11 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:12.746773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:12.747438 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:12.755295 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:12.755770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:12.756196 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:12.756882 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:12.757327 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:12.758000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:12.820343 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:12.828058 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-66788e9c-2e60-495e-9f90-c3fc8766feb9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1187 microversion: 2.1 time: 0.085210 Aug 30 00:03:12.828627 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 245/512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:12 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:13.851056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:13.851679 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:13.857960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:13.858436 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:13.858943 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:13.859575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:13.860021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:13.860445 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:13.921378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:13.929217 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9f450e4d-a7fb-46a8-9782-4ae6979e3ae8 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1205 microversion: 2.1 time: 0.081954 Aug 30 00:03:13.930212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 268/513] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:13 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1205 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:14.890701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-adfdb062-3e5d-4996-9d03-edc672d6d886 req-8fccaada-8ea8-447b-a928-8db6a59b8805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a7c39c-c5e6-4553-be70-454ad70a50da", "tag": "a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:14.900758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-adfdb062-3e5d-4996-9d03-edc672d6d886 req-8fccaada-8ea8-447b-a928-8db6a59b8805 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:14.901189 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-adfdb062-3e5d-4996-9d03-edc672d6d886 req-8fccaada-8ea8-447b-a928-8db6a59b8805 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:14.901608 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-adfdb062-3e5d-4996-9d03-edc672d6d886 req-8fccaada-8ea8-447b-a928-8db6a59b8805 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:14.912951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-adfdb062-3e5d-4996-9d03-edc672d6d886 req-8fccaada-8ea8-447b-a928-8db6a59b8805 service nova] Creating event network-changed:a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802 for instance d0a7c39c-c5e6-4553-be70-454ad70a50da on hv-cinder-85427 Aug 30 00:03:14.918453 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-adfdb062-3e5d-4996-9d03-edc672d6d886 req-8fccaada-8ea8-447b-a928-8db6a59b8805 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031485 Aug 30 00:03:14.919545 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 246/514] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:14.950760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:14.951482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:14.958109 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:14.958852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:14.959304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:14.960021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:14.960478 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:14.960982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:15.098997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:15.112496 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-33c65d67-fa1c-4c16-9ae2-86cbeec9b7cb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1273 microversion: 2.1 time: 0.160579 Aug 30 00:03:15.112496 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 269/515] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:14 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:15.451052 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:15.454194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:15.460293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:15.460772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:15.461202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:15.462077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:15.462369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:15.462821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:15.486150 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lazy-loading 'flavor' on Instance uuid 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:03:15.792631 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b0bc9b59-f4e4-48cc-8b7e-d7ebbc4b6592 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/action" status: 200 len: 32 microversion: 2.1 time: 0.346004 Aug 30 00:03:15.793268 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 247/516] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:03:15 2022] POST /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/action => generated 32 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:03:15.802696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:15.803304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:15.809383 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:15.809870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:15.810308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:15.811063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:15.815154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:15.815154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:15.940106 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:15.948254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dac657ed-c5f8-4d64-ac55-db1458ce2171 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.149424 Aug 30 00:03:15.948811 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 270/517] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:15 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:16.130213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:16.130981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:16.137574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:16.138050 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:16.138490 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:16.139897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:16.140340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:16.140754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:16.571728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:16.579440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-016a8978-5823-45ae-92a7-323fc0e78583 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.454011 Aug 30 00:03:16.579988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 248/518] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:16 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:16.970028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:16.970666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:16.977598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:16.978021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:16.978462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:16.979195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:16.979687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:16.980134 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:17.107671 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:17.115808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-23a92745-fd60-4643-aef0-51b143c8b806 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.150227 Aug 30 00:03:17.116379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 271/519] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:16 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:17.600980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:17.601582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:17.608783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:17.609258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:17.609688 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:17.610373 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:17.610852 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:17.611276 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:17.753692 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:17.761945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-af891c07-a624-4819-9ebd-90f7d786ada3 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.164832 Aug 30 00:03:17.762528 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 249/520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:17 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:18.137089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:18.137698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:18.144784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:18.145264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:18.145703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:18.146393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:18.146873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:18.147298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:18.276912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:18.285048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6be3bb99-f4af-47e2-afc4-2c1a34b79403 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.152071 Aug 30 00:03:18.285616 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 272/521] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:18 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:18.782822 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:18.784329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:18.789796 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:18.790302 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:18.790775 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:18.791470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:18.791918 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:18.792339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:18.919812 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:18.928089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e784ea56-70be-4d0d-a7a6-3c3c1e5b9d6d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.149131 Aug 30 00:03:18.928653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 250/522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:18 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:19.306417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:19.306966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:19.313406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:19.313870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:19.314296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:19.315007 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:19.315450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:19.315866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:19.443738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:19.452486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3ee9f711-343b-441b-98bb-38e06c72d0c3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.149962 Aug 30 00:03:19.453055 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 273/523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:19 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:19.948544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:19.949142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:19.955972 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:19.961304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:19.961304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:19.961304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:19.961304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:19.961689 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:20.099000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:20.106852 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d78ef038-2669-4fcc-b2de-efb4d2a06daa tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.162135 Aug 30 00:03:20.107426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 251/524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:19 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:20.473113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:20.473719 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:20.475641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:20.476324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=6 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:20.481398 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:20.481876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:20.482308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:20.483033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:20.483482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:20.487725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:20.614419 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:20.622647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7cfe60f5-e007-4e94-a44b-d67e32f5ce5b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.153355 Aug 30 00:03:20.623211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 274/525] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:20 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:21.128474 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:21.129442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:21.131418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:21.136941 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.137420 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.137848 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.138556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.139648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.140115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.272083 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:21.278955 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b72f5c0f-9a61-4a7a-a214-5cbc2e93b87c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.154424 Aug 30 00:03:21.279599 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 252/526] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:21 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:21.643893 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:21.644507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:21.650905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.651391 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.651825 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.652541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.652997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.653420 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.717431 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:21.718057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:21.724262 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.724736 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.725163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.725845 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.726287 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.726723 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.783917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:21.792345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a988bc9c-f259-4779-8ed6-488098e97b25 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.152280 Aug 30 00:03:21.792845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 275/527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:21 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:21.852451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lazy-loading 'services' on Instance uuid 68880fbb-7000-4185-b41d-5b4241962ca9 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:03:22.096602 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8d66d391-571d-417f-b27e-c59fa11828ed tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-volume_attachments/f6eec293-3116-4b8b-ad54-0c40a329956b" status: 202 len: 0 microversion: 2.1 time: 0.382890 Aug 30 00:03:22.097119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 253/528] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:03:21 2022] DELETE /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-volume_attachments/f6eec293-3116-4b8b-ad54-0c40a329956b => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:03:22.299851 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:22.300533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:22.306627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:22.307109 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:22.307544 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:22.308227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:22.308679 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:22.309101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:22.449290 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:22.456980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7cf8dd4d-d25d-4e17-aba6-24912f214a13 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.160900 Aug 30 00:03:22.457542 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 276/529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:22 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:22.814011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:22.814734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:22.820792 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:22.821297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:22.821727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:22.825315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:22.825315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:22.825315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:22.953652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:22.961839 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-49d7b2dd-491e-4e86-894f-6b7def9babcb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.152394 Aug 30 00:03:22.962343 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 254/530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:22 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:23.477794 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:23.478489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:23.484916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:23.485400 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:23.485834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:23.486552 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:23.487008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:23.487429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:23.617231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:23.625665 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-18bec7a6-bbca-4d9e-aa0b-2604472afe5e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.151904 Aug 30 00:03:23.626258 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 277/531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:23 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:23.983737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:23.984450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:23.987059 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=34 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:23.991833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:23.992326 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:23.992757 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:23.993450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:23.993903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:23.994322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:24.136918 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:24.145731 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-44a4a36a-153f-40a5-9a60-5c7abc4fe5f7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.165838 Aug 30 00:03:24.146295 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 255/532] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:23 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:24.273966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8490e1fd-90b1-44a0-8cbc-f4df974e7d17 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:24.280488 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8490e1fd-90b1-44a0-8cbc-f4df974e7d17 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:24.280967 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8490e1fd-90b1-44a0-8cbc-f4df974e7d17 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:24.281496 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8490e1fd-90b1-44a0-8cbc-f4df974e7d17 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:24.303516 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8490e1fd-90b1-44a0-8cbc-f4df974e7d17 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Going to try to stop instance {{(pid=127769) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 00:03:24.483565 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8490e1fd-90b1-44a0-8cbc-f4df974e7d17 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.213400 Aug 30 00:03:24.484460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 278/533] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:03:24 2022] POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:03:24.492800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:24.493409 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:24.499606 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:24.500070 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:24.500500 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:24.501231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:24.501688 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:24.502093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:24.629207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:24.637513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cef47496-944d-46d1-afc5-ea1a05b40c71 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.148705 Aug 30 00:03:24.638083 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 256/534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:24 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:24.647142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:24.647831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:24.654024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:24.654433 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:24.654902 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:24.655571 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:24.656900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:24.657304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:24.787578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:24.795254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-bf6533d5-f706-48e7-b846-f1f035c77fcb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.152310 Aug 30 00:03:24.795831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 279/535] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:24 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:25.167594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:25.168194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:25.175158 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.175631 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.176069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.176753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.177202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.177621 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.192547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:25.318111 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:25.326290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-542cedcb-c684-44bb-88a7-87e3d9b15022 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.162546 Aug 30 00:03:25.326899 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 257/536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:25 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:25.529211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-df266000-cd41-4720-8d1a-fd6ee8127e7c req-bb766959-9f0c-432c-8b17-a2b9d22c3f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a7c39c-c5e6-4553-be70-454ad70a50da", "name": "network-vif-plugged", "status": "completed", "tag": "a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:25.539070 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-df266000-cd41-4720-8d1a-fd6ee8127e7c req-bb766959-9f0c-432c-8b17-a2b9d22c3f9e service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.539574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-df266000-cd41-4720-8d1a-fd6ee8127e7c req-bb766959-9f0c-432c-8b17-a2b9d22c3f9e service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.540003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-df266000-cd41-4720-8d1a-fd6ee8127e7c req-bb766959-9f0c-432c-8b17-a2b9d22c3f9e service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.551662 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-df266000-cd41-4720-8d1a-fd6ee8127e7c req-bb766959-9f0c-432c-8b17-a2b9d22c3f9e service nova] Creating event network-vif-plugged:a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802 for instance d0a7c39c-c5e6-4553-be70-454ad70a50da on hv-cinder-85427 Aug 30 00:03:25.556517 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-df266000-cd41-4720-8d1a-fd6ee8127e7c req-bb766959-9f0c-432c-8b17-a2b9d22c3f9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030983 Aug 30 00:03:25.557116 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 280/537] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:25.659595 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:25.660200 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:25.666177 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.666775 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.667107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.667817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.668262 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.668679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.806338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:25.815133 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c9ba913a-b3f7-4818-be31-b6077572a761 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.159788 Aug 30 00:03:25.816975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:25.817921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:25.819079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 258/538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:25 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:25.824840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.825427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.826157 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.827082 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.827634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.828262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.962518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:25.970299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c6937e87-3cec-425f-9bf1-82af89e0745b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.157999 Aug 30 00:03:25.970890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 281/539] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:25 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:26.347586 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:26.348184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:26.354544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.355023 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.355452 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:26.356136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.356581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.357029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:26.488988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:26.497093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8ceb301e-fa7a-4d70-8399-4e209122135b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.153917 Aug 30 00:03:26.497669 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 259/540] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:26 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:26.835295 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:26.835897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:26.842457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.842957 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.843388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:26.844150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.844681 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.845132 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:26.977325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:26.980831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:26.985962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2d50cd25-46a0-49b9-8a05-c793908085f8 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.154537 Aug 30 00:03:26.986543 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 282/541] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:26 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:26.990194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:26.990824 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:26.996736 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.997212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.997643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:26.998330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.998804 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.999220 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:27.129515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:27.138506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5f1887b2-3833-4ba6-97f2-c2c3cb4037fc tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1261 microversion: 2.1 time: 0.152015 Aug 30 00:03:27.139137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 260/542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:26 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:27.519839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:27.520453 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:27.526801 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:27.527284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:27.527720 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:27.528403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:27.528855 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:27.529347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:27.659996 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:27.669754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0738ad08-87f7-4c00-8f3d-4a4d67a1a209 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.152906 Aug 30 00:03:27.669754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 283/543] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:27 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:28.008365 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:28.009007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:28.016556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.017043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.018499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.018499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.019088 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.019489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.151195 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:28.159850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6bb8f298-6b87-4213-8e42-5c57962dab88 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.155594 Aug 30 00:03:28.164128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:28.164593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 261/544] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:28 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:28.164731 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:28.167423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.167905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.168340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.169035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.169485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.169912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.297822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:28.305496 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-61487b28-bba2-49fa-9c71-dd232f69ceac tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1445 microversion: 2.1 time: 0.149991 Aug 30 00:03:28.306056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 284/545] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:28 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:28.324966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:28.325561 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:28.331922 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.332396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.332854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.333534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.333979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.334396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.461041 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:28.469246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-080df9dc-da69-4396-8a99-115f1045549c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1445 microversion: 2.1 time: 0.148080 Aug 30 00:03:28.469800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 262/546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:28 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1445 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:28.715351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:28.715661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:28.721855 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.722333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.722794 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.723559 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.724038 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.724458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.851463 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:28.859983 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d29e4c56-db68-46af-a050-ae74f86fe453 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.148877 Aug 30 00:03:28.860558 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 285/547] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:28 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:29.181392 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:29.182134 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:29.189127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.189608 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.190060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:29.190766 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.191214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.191632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:29.404506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:29.412767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-eaf8ee21-f8ca-4685-a71e-8d5bfd308366 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.235476 Aug 30 00:03:29.413339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 263/548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:29 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:29.881671 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:29.882290 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:29.889015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.889503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.889945 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:29.890697 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.891152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.891579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.030973 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:30.038589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4a851248-a966-40b3-9219-0d9b443d3871 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.160875 Aug 30 00:03:30.039352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 286/549] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:29 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:30.306137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:30.306706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:30.313419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.314597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.314597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.315397 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.315913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.316330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.346281 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a6974eea-49ff-4470-92a0-792dda59fb54 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments/f87b8426-551d-4aa8-bfb3-869562578c42" status: 200 len: 194 microversion: 2.20 time: 0.044156 Aug 30 00:03:30.347079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 264/550] 10.222.0.60 () {60 vars in 1454 bytes} [Tue Aug 30 00:03:30 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments/f87b8426-551d-4aa8-bfb3-869562578c42 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:03:30.403717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-f607161f-8d1e-4317-8836-003bb2608512 req-100bea36-66d6-4101-89fe-b81f9b67466f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a7c39c-c5e6-4553-be70-454ad70a50da", "tag": "a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:30.416174 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f607161f-8d1e-4317-8836-003bb2608512 req-100bea36-66d6-4101-89fe-b81f9b67466f service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.416775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f607161f-8d1e-4317-8836-003bb2608512 req-100bea36-66d6-4101-89fe-b81f9b67466f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.417268 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f607161f-8d1e-4317-8836-003bb2608512 req-100bea36-66d6-4101-89fe-b81f9b67466f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.426182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:30.426699 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:30.433080 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-f607161f-8d1e-4317-8836-003bb2608512 req-100bea36-66d6-4101-89fe-b81f9b67466f service nova] Creating event network-changed:a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802 for instance d0a7c39c-c5e6-4553-be70-454ad70a50da on hv-cinder-85427 Aug 30 00:03:30.433477 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.433937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.434588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.435473 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.436076 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.436645 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.438861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-f607161f-8d1e-4317-8836-003bb2608512 req-100bea36-66d6-4101-89fe-b81f9b67466f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041033 Aug 30 00:03:30.439406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 287/551] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:30.444853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:30.445556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:30.451832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.452315 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.453332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.454985 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.455452 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.456071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.537871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lazy-loading 'services' on Instance uuid bfa3cd3e-c701-4851-a613-4c89ea690072 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:03:30.610181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:30.618919 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ed9dc802-451f-4fb7-b9bb-b9dbf0501912 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.178096 Aug 30 00:03:30.619908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 288/552] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:30 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:30.734642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-40902f8a-9bce-453a-b267-1619e71b9e9c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments/f87b8426-551d-4aa8-bfb3-869562578c42" status: 202 len: 0 microversion: 2.20 time: 0.313952 Aug 30 00:03:30.735809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 265/553] 10.222.0.60 () {60 vars in 1457 bytes} [Tue Aug 30 00:03:30 2022] DELETE /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments/f87b8426-551d-4aa8-bfb3-869562578c42 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 00:03:30.744622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:30.746858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:30.752936 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.753598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.754042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.754774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.755226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.755648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.788187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-680e7993-224a-4c32-abbb-47556b294e80 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048095 Aug 30 00:03:30.789099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 289/554] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 30 00:03:30 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:31.060732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:31.061364 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:31.068153 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.068672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.069110 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.069794 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.070246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.070695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.203755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:31.212217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-847adfbd-0ba4-447c-84cd-dfef246729e1 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.155623 Aug 30 00:03:31.213298 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 266/555] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:31 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:31.640183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:31.640782 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:31.647197 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.647682 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.648115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.648802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.649269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.649788 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.786709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:31.797121 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-eea9b87b-67fd-43d3-ae9f-76865b6ba6f5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.160177 Aug 30 00:03:31.797990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 290/556] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:31 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:31.801459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:31.803730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:31.810271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.810781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.811206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.811901 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.812324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.812737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.843735 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-61a3b5dc-d23d-40c2-9d05-0b652b7cfb95 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046408 Aug 30 00:03:31.844204 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 267/557] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 30 00:03:31 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:31.907625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:31.908514 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:31.914815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.915291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.915719 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.916397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.916846 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.917288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.942022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:03:32.165587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7cbcd105-3bd8-4058-b753-58c26b2f3df9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 204 len: 0 microversion: 2.20 time: 0.262115 Aug 30 00:03:32.166089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 291/558] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 30 00:03:31 2022] DELETE /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 00:03:32.174067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:32.174806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:32.180768 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.181225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.181638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.182512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.182786 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.183206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.233928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:32.234658 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:32.241145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.241707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.242179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.242890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.243390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.243814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.318508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:32.327060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:32.329244 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:32.330534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f37bf79a-5c87-41d2-a957-00a51ff9dfeb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.160256 Aug 30 00:03:32.331185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 268/559] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:32 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:32.372497 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:32.381294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0c79e51a-c0bf-46db-8355-e94163fb72a3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.151818 Aug 30 00:03:32.381861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 292/560] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:32 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:32.828060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:32.828674 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:32.834678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.835152 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.835578 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.836280 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.836718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.837128 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.967825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:32.969954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a2f263d3-e94a-430e-8ff5-ab9a64365000 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.154793 Aug 30 00:03:32.970524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 269/561] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:32 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:33.352754 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:33.353327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:33.360376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.360846 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.361274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.361956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.362404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.362857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.403100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:33.404018 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:33.410162 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.410685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.411120 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.411817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.412269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.412821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.504382 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:33.513318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:33.514780 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:33.516458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-814fc170-929d-47f8-b125-765b197fff0b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.167771 Aug 30 00:03:33.517016 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 293/562] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:33 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:33.562055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:33.570617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1885cd98-8a27-47e0-a2de-29bf979b4f19 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.171496 Aug 30 00:03:33.572537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 270/563] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:33 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:33.991206 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:33.991917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:33.997918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.998406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.998887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.000115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.000571 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.001004 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.131792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.139727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2623a323-6ee6-45b7-8e9c-8d1936d31cb1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.152452 Aug 30 00:03:34.140326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 294/564] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:33 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:34.540354 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:34.540951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:34.547290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.548381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.548806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.549480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.549922 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.550334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.591508 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:34.592228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:34.599185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.599741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.600269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.601027 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.601553 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.601983 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.678242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.686516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.688151 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.689358 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2d9d2f2b-3f78-46e9-a5b4-07bccc10f946 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.152970 Aug 30 00:03:34.690019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 271/565] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:34 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:34.737272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.745338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e537245d-8219-4528-831d-1639301e7ed3 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.157769 Aug 30 00:03:34.745891 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 295/566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:34 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:35.161258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:35.161858 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:35.168738 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.169218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.169648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.170329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.170806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.171230 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.601120 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:35.609053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-56b6b72a-f99e-4b71-a33e-401a307547d6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1677 microversion: 2.1 time: 0.451593 Aug 30 00:03:35.609685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 272/567] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:35 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1677 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:35.712941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:35.713565 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:35.720794 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.721280 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.721714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.722405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.723011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.723436 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.767814 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:35.768497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:35.774770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.775334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.775839 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.776761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.777447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.777943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.794644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:35.874231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:35.882272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:35.884009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:35.885153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7092ad79-2a64-4e15-ac21-b653cc636d93 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1723 microversion: 2.20 time: 0.176201 Aug 30 00:03:35.885701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 296/568] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:35 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:36.056549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:36.065263 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-90a77386-b746-4657-963b-cd0b5a2bc8c2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.302238 Aug 30 00:03:36.070028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 273/569] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:35 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:36.559314 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-b811ca36-fd1a-42b5-8b7a-e956f71c6a17 req-0be0dae3-bac8-4a53-b8d4-302c103ebd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa3cd3e-c701-4851-a613-4c89ea690072", "name": "network-vif-deleted", "tag": "7aa950fd-42ef-47f2-90db-cffca1a6595c"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:36.569548 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-b811ca36-fd1a-42b5-8b7a-e956f71c6a17 req-0be0dae3-bac8-4a53-b8d4-302c103ebd65 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.570036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-b811ca36-fd1a-42b5-8b7a-e956f71c6a17 req-0be0dae3-bac8-4a53-b8d4-302c103ebd65 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.570497 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-b811ca36-fd1a-42b5-8b7a-e956f71c6a17 req-0be0dae3-bac8-4a53-b8d4-302c103ebd65 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.582947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-b811ca36-fd1a-42b5-8b7a-e956f71c6a17 req-0be0dae3-bac8-4a53-b8d4-302c103ebd65 service nova] Creating event network-vif-deleted:7aa950fd-42ef-47f2-90db-cffca1a6595c for instance bfa3cd3e-c701-4851-a613-4c89ea690072 on hv-cinder-85427 Aug 30 00:03:36.588178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-b811ca36-fd1a-42b5-8b7a-e956f71c6a17 req-0be0dae3-bac8-4a53-b8d4-302c103ebd65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032384 Aug 30 00:03:36.593252 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 297/570] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:36.631477 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:36.632137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:36.638665 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.641762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.641762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.641762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.641762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.642145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.809797 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:36.823018 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ace91e26-8375-4f9f-93f6-3949a7404bfc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1654 microversion: 2.1 time: 0.195093 Aug 30 00:03:36.827254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 274/571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:36 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1654 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:36.845772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f5f0278f-e12f-4477-94e5-e36cee93ef1a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:36.852127 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f5f0278f-e12f-4477-94e5-e36cee93ef1a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.852620 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f5f0278f-e12f-4477-94e5-e36cee93ef1a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.853055 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f5f0278f-e12f-4477-94e5-e36cee93ef1a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.877212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f5f0278f-e12f-4477-94e5-e36cee93ef1a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Going to try to start instance {{(pid=127769) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 00:03:36.900209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:36.911229 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:36.912213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:36.918404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.918951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.919383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.920104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.920555 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.920971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.956497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.956983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.957416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.957876 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lazy-loading 'fault' on Instance uuid bfa3cd3e-c701-4851-a613-4c89ea690072 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:03:37.002638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:37.015799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:37.017512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:37.019782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-73f8b899-4df9-4b2a-9c9c-06ff97b47fc8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 200 len: 1371 microversion: 2.20 time: 0.114728 Aug 30 00:03:37.021193 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 275/572] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:36 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:03:37.089001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:37.090515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:37.098078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:37.099011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:37.099749 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:37.100616 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:37.101284 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:37.101867 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:37.119366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f5f0278f-e12f-4477-94e5-e36cee93ef1a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.278307 Aug 30 00:03:37.121305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 298/573] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:03:36 2022] POST /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:03:37.128840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:37.129586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:37.137160 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:37.137644 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:37.138274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:37.139011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:37.139467 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:37.140080 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:37.269364 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:37.279585 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cb54b01f-ffe1-4270-8504-86741221c696 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1732 microversion: 2.1 time: 0.195158 Aug 30 00:03:37.288586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:37.294176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 276/574] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:37 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1732 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:37.297170 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5b54ed33-1502-4635-a5ac-7c26bd91acdb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1663 microversion: 2.1 time: 0.172462 Aug 30 00:03:37.297980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 299/575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:37 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:38.043324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:38.044858 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:38.053529 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.054022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.054454 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.055413 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.055851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.056267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.071404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] HTTP exception thrown: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Request method failure captured: Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 HTTP/1.1 Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLtgufVo4C5xeCOe9RkNDJEQSqA_5sGsmH3FiLB8wi-0hP94XC051Deog0u7pDmW_M5FuFhm1seWi2FSE8H_p3qvAXnjJdUd8WcckvwNLRXMlPfBUOphQiVxAAXjvsZWIOtGumY-7wI3pXFtNYkSDMq5xnXY9fEVgZibZcRgCsiD5E Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:03:38.073082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}] Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 7812e8e2bc794f1cbd19c1c176bb93af Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:03:38.074781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'bfa3cd3e-c701-4851-a613-4c89ea690072'} Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:03:38.079345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:03:38.080755 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.082104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Returning 404 to user: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:03:38.082104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-eeed3524-0a38-4831-b17e-4b3b36e761d7 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 404 len: 111 microversion: 2.20 time: 0.035172 Aug 30 00:03:38.082104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 277/576] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:38 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:03:38.088329 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d4c78a3b-4260-43fa-ada5-64fb11f78f01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '.version_select at 0x7f09bf40d1f0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:38.161758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d4c78a3b-4260-43fa-ada5-64fb11f78f01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109459989" status: 204 len: 0 microversion: 2.20 time: 0.078106 Aug 30 00:03:38.162342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 300/577] 10.222.0.60 () {60 vars in 1259 bytes} [Tue Aug 30 00:03:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109459989 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 00:03:38.302176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:38.303148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:38.309287 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.309882 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.310418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.311240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.313459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.313459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.318631 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:38.320193 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:38.328629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.333396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.335363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.338306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.338906 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.339439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.476619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:38.484897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-61a92819-3cde-4c35-a62b-589d2772ee8d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1712 microversion: 2.1 time: 0.187489 Aug 30 00:03:38.492919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 278/578] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:38 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1712 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:38.493183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:38.500502 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7940cff8-3469-4563-afc8-f9412a86d650 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1663 microversion: 2.1 time: 0.185743 Aug 30 00:03:38.501071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 301/579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:38 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1663 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:38.599984 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:38.600473 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:38.606321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.606834 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.607261 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.607947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.608440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.608816 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.694241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] HTTP exception thrown: Cannot 'detach_volume' instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd while it is in vm_state rescued Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Request method failure captured: Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments/27a95b92-c72a-4930-87b4-e48e03f46421 HTTP/1.1 Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLqpgnE_Ii-S0Ne3Nsfgbd6JBmuliRuSshaGbLD5BOvWn30wij20w9qsKcR37vZB8fQAPEAA2E90vUrUAMDGzq_dBiWr5GoRvMro0QKlSEsyvAy3pEzbh8pz9RNTkvlj0eUgF0x4KUqWetwmdI46ldVB-vEV1KhwJH--SzNfuJ376I Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:03:38.695782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}] Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: e0a5a4228c5d41c7898aa768dfe359ca Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:03:38.697325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Cannot 'detach_volume' instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd while it is in vm_state rescued Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'server_id': '47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd', 'id': '27a95b92-c72a-4930-87b4-e48e03f46421'} Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:03:38.698107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd while it is in vm_state rescued Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd while it is in vm_state rescued Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:03:38.699594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Returning 409 to user: Cannot 'detach_volume' instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd while it is in vm_state rescued {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:03:38.700716 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ccec3e27-5427-4ab0-95ad-fe4d190ad87d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "DELETE /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments/27a95b92-c72a-4930-87b4-e48e03f46421" status: 409 len: 152 microversion: 2.1 time: 0.101210 Aug 30 00:03:38.701289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 279/580] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:03:38 2022] DELETE /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments/27a95b92-c72a-4930-87b4-e48e03f46421 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 00:03:38.707283 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:38.707939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:38.714458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.715271 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.715897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.716854 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.717320 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.717751 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.907932 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-86b56f36-aa90-4c1d-bd86-5b7a7884cfa9 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "POST /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/action" status: 202 len: 0 microversion: 2.1 time: 0.204795 Aug 30 00:03:38.916571 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 302/581] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:03:38 2022] POST /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:03:38.916707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:38.917168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:38.923172 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.923659 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.924044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.924724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.925174 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.925593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:39.066895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:39.075596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7f35f84e-e875-494f-b45b-a5f9b05e7d80 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1720 microversion: 2.1 time: 0.162747 Aug 30 00:03:39.076389 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 280/582] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:38 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:39.314805 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9896bfc9-3573-44c3-a62a-44e0410ff66f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'create', calling method: .version_select at 0x7f09bf2c7670>, body: {"keypair": {"name": "tempest-keypair-1110301350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInX5GT2kqKcDQw6rSNRxosyDka4iJZDy6VD+x2AF+5IFdMBvGX2ZKJpbYxdWj0IfYsM5KRVhJ6EbrekviHNi/hnSQUmF+pn8BeT6Pmwls6672Kyty2sXWnhN4lXi48W6A=="}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:39.321402 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:39.337851 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-9896bfc9-3573-44c3-a62a-44e0410ff66f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:03:39.342199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-9896bfc9-3573-44c3-a62a-44e0410ff66f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for user 7812e8e2bc794f1cbd19c1c176bb93af and project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:03:39.430185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9896bfc9-3573-44c3-a62a-44e0410ff66f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.120697 Aug 30 00:03:39.431454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 303/583] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Aug 30 00:03:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:39.522386 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:39.523140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:39.529462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:39.530188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:39.530650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:39.535649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:39.535649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:39.535649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:39.760959 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:39.768789 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b34e1f86-4983-4ce7-b838-a9b9d06d0f7b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1667 microversion: 2.1 time: 0.250305 Aug 30 00:03:39.769527 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 281/584] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:39 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1667 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:40.098599 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:40.099325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:40.105701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:40.106176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:40.106661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:40.112405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:40.112405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:40.112405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:40.236444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:40.244753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5c6c3511-c463-4bfe-a06d-2c2fba324db7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1720 microversion: 2.1 time: 0.151141 Aug 30 00:03:40.245322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 304/585] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:40 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:41.265289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:41.266067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:41.273236 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:41.273709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:41.274139 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:41.274850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:41.275300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:41.275718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:41.447536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:41.456553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d7edfe15-1645-46ca-9179-4b6ea5ecc055 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1720 microversion: 2.1 time: 0.195120 Aug 30 00:03:41.457132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 282/586] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:41 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:41.592926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-983764988", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8558be8c-cad1-43e0-982e-6ed2ea36eb48"}], "security_groups": [{"name": "tempest-securitygroup--1342683570"}], "key_name": "tempest-keypair-1110301350", "user_data": "}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:41.702232 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] validate_networks() for [('8558be8c-cad1-43e0-982e-6ed2ea36eb48', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:03:42.079167 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:03:42.080220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:03:42.080725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:03:42.081156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:03:42.081563 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:03:42.090733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:42.091368 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:42.091803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:42.092526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:42.092984 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:42.093407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:42.110534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:03:42.114686 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Getting quotas for user 7812e8e2bc794f1cbd19c1c176bb93af and project 1f7a55e59082408b8cb5822d7bd33478. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:03:42.125920 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:03:42.128858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:03:42.249416 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1deb59cf-a060-4077-bc9e-46c288251a63 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.660389 Aug 30 00:03:42.250440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 305/587] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Aug 30 00:03:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 00:03:42.262495 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-28d51e1f-bf00-4acd-ab77-ceaeb93e07c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:42.263096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-28d51e1f-bf00-4acd-ab77-ceaeb93e07c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:42.321321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-28d51e1f-bf00-4acd-ab77-ceaeb93e07c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:42.329133 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-28d51e1f-bf00-4acd-ab77-ceaeb93e07c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:42.331347 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-28d51e1f-bf00-4acd-ab77-ceaeb93e07c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:42.332465 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-28d51e1f-bf00-4acd-ab77-ceaeb93e07c0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1281 microversion: 2.20 time: 0.073871 Aug 30 00:03:42.333012 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 283/588] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:42 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:03:42.477692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:42.478306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:42.484454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:42.485050 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:42.485486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:42.486695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:42.487147 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:42.487563 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:42.622540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:42.632364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dfbc62e3-9c5f-4809-b813-1f9c4aa48ed7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1720 microversion: 2.1 time: 0.158409 Aug 30 00:03:42.633196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 306/589] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:42 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:43.355647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:43.356276 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:43.368297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.368297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.368297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.368297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.368750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.368750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.430746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:43.438863 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:43.440320 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:43.441404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-48ba9073-0375-47f4-86b9-d60855e66d2f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1285 microversion: 2.20 time: 0.089775 Aug 30 00:03:43.441950 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 284/590] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:43 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:43.654028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:43.655253 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:43.661738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.662218 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.662678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.663374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.663819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.664237 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.800807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:43.810790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-de18547b-e5f6-4dcc-9fc8-78239f6caabd tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1726 microversion: 2.1 time: 0.160636 Aug 30 00:03:43.814639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 307/591] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:43 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:43.832176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:43.832668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:43.838725 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.839206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.839848 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.840539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.841160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.841583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.934922 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c72fc456-cbee-4a6e-88e3-f5cf6a7dbd93 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107072 Aug 30 00:03:43.935692 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 285/592] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:03:43 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:44.464478 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:44.465490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:44.472935 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:44.473525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:44.486629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:44.486629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:44.486629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:44.486629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:44.542761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:44.553194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:44.553774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:44.555157 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1431b173-d65f-4608-883d-f5cb0458934f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1341 microversion: 2.20 time: 0.094507 Aug 30 00:03:44.555958 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 308/593] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:44 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1341 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:44.946256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-e83b344e-a2ee-4410-85fb-c383b349c3f2 req-dc82aedd-4e5d-4a39-9e74-39601bf6551a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd", "tag": "95eb0348-4d8c-4314-b169-75e6e905f723"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:44.960985 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-e83b344e-a2ee-4410-85fb-c383b349c3f2 req-dc82aedd-4e5d-4a39-9e74-39601bf6551a service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:44.961462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-e83b344e-a2ee-4410-85fb-c383b349c3f2 req-dc82aedd-4e5d-4a39-9e74-39601bf6551a service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:44.962797 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-e83b344e-a2ee-4410-85fb-c383b349c3f2 req-dc82aedd-4e5d-4a39-9e74-39601bf6551a service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:44.979046 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-e83b344e-a2ee-4410-85fb-c383b349c3f2 req-dc82aedd-4e5d-4a39-9e74-39601bf6551a service nova] Creating event network-changed:95eb0348-4d8c-4314-b169-75e6e905f723 for instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd on hv-cinder-85427 Aug 30 00:03:44.985231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-e83b344e-a2ee-4410-85fb-c383b349c3f2 req-dc82aedd-4e5d-4a39-9e74-39601bf6551a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043933 Aug 30 00:03:44.985231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 286/594] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:45.580916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:45.582442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:45.589069 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:45.589545 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:45.595632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:45.595632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:45.595632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:45.595632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:45.659785 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:45.670134 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:45.671960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:45.673810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-39a7f694-0732-4cd6-a338-88ae1f47cfbb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1339 microversion: 2.20 time: 0.096334 Aug 30 00:03:45.682582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 309/595] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:45 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:45.999835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:46.000423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:46.007345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.008340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.008930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.013698 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.013698 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.013698 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.036800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-019eb64c-4620-4640-841a-ba07d10483f6 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c/ips" status: 200 len: 150 microversion: 2.1 time: 0.041841 Aug 30 00:03:46.037384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 287/596] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:03:45 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:46.050092 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96d2cc13-2770-411e-82fe-2f79061706d2"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:46.053414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:46.059622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.060012 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.060453 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.061157 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.061607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.062210 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.147474 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Invalid volume: volume 96d2cc13-2770-411e-82fe-2f79061706d2 is already attached to instances: a9105900-32ff-4338-bffd-cdf09407a6a6 Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: POST /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c/os-volume_attachments HTTP/1.1 Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 74 Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:03:46.149326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {"volumeAttachment": {"volumeId": "96d2cc13-2770-411e-82fe-2f79061706d2"}} Aug 30 00:03:46.150964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Invalid volume: volume 96d2cc13-2770-411e-82fe-2f79061706d2 is already attached to instances: a9105900-32ff-4338-bffd-cdf09407a6a6 Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'server_id': '7d2e61a5-53b5-471d-994c-e914bc29062c', 'body': {'volumeAttachment': {'volumeId': '96d2cc13-2770-411e-82fe-2f79061706d2'}}} Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 96d2cc13-2770-411e-82fe-2f79061706d2 is already attached to instances: a9105900-32ff-4338-bffd-cdf09407a6a6 Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:46.151822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 96d2cc13-2770-411e-82fe-2f79061706d2 is already attached to instances: a9105900-32ff-4338-bffd-cdf09407a6a6 Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:46.153111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 96d2cc13-2770-411e-82fe-2f79061706d2 is already attached to instances: a9105900-32ff-4338-bffd-cdf09407a6a6 Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 400 to user: Invalid volume: volume 96d2cc13-2770-411e-82fe-2f79061706d2 is already attached to instances: a9105900-32ff-4338-bffd-cdf09407a6a6 {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0e592de3-5023-486c-8456-b5f4ac62c2a0 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105494 Aug 30 00:03:46.154540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 310/597] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:03:46 2022] POST /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:03:46.161005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:46.161497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:46.167581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.168066 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.168499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.169182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.169628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.170047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.195260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:03:46.543601 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-69f642d0-1a6f-42be-9356-e85c6d40efd9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 204 len: 0 microversion: 2.1 time: 0.386676 Aug 30 00:03:46.544192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 288/598] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:03:46 2022] DELETE /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:03:46.554165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:46.554818 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:46.560924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.561397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.561821 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.562511 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.563046 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.563465 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.619004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-fc95932d-e9b5-423d-b8e4-c4b3d3c896cf req-3bd5da14-61d3-447b-bead-c253a1c4b388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b0f865-8bd9-4058-93d8-be5258b0ffa0", "tag": "9971a71c-35a8-48ef-95f0-0729bcc06055"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:46.628752 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-fc95932d-e9b5-423d-b8e4-c4b3d3c896cf req-3bd5da14-61d3-447b-bead-c253a1c4b388 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.629454 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-fc95932d-e9b5-423d-b8e4-c4b3d3c896cf req-3bd5da14-61d3-447b-bead-c253a1c4b388 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.629886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-fc95932d-e9b5-423d-b8e4-c4b3d3c896cf req-3bd5da14-61d3-447b-bead-c253a1c4b388 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.641751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-fc95932d-e9b5-423d-b8e4-c4b3d3c896cf req-3bd5da14-61d3-447b-bead-c253a1c4b388 service nova] Creating event network-changed:9971a71c-35a8-48ef-95f0-0729bcc06055 for instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 on hv-cinder-85427 Aug 30 00:03:46.647054 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-fc95932d-e9b5-423d-b8e4-c4b3d3c896cf req-3bd5da14-61d3-447b-bead-c253a1c4b388 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032171 Aug 30 00:03:46.648172 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 289/599] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:03:46.699831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:46.704652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:46.705368 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:46.708114 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-435e4c97-d59c-46e9-a759-cf7f29c77e19 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1682 microversion: 2.1 time: 0.158751 Aug 30 00:03:46.708678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 311/600] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:46 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:46.715000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.715489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.715920 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.716646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.717095 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.717509 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.845945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:46.854011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:46.855494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:46.856580 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7fc6f0c2-43d6-497d-805c-a174c514af1f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.156247 Aug 30 00:03:46.857138 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 290/601] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:46 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:46.999017 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-7feba437-21dc-4e4e-be44-d5aba20e0416 req-f5dbc41f-d274-436d-a380-2013d6296f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd", "tag": "95eb0348-4d8c-4314-b169-75e6e905f723"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:47.008564 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7feba437-21dc-4e4e-be44-d5aba20e0416 req-f5dbc41f-d274-436d-a380-2013d6296f65 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.009024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7feba437-21dc-4e4e-be44-d5aba20e0416 req-f5dbc41f-d274-436d-a380-2013d6296f65 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.009464 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7feba437-21dc-4e4e-be44-d5aba20e0416 req-f5dbc41f-d274-436d-a380-2013d6296f65 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.021162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-7feba437-21dc-4e4e-be44-d5aba20e0416 req-f5dbc41f-d274-436d-a380-2013d6296f65 service nova] Creating event network-changed:95eb0348-4d8c-4314-b169-75e6e905f723 for instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd on hv-cinder-85427 Aug 30 00:03:47.026837 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-7feba437-21dc-4e4e-be44-d5aba20e0416 req-f5dbc41f-d274-436d-a380-2013d6296f65 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031430 Aug 30 00:03:47.027420 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 312/602] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:47.731402 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:47.732004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:47.738442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.738951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.739385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.740072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.740526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.740953 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.880875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:47.881572 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:47.890112 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.890641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.891140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.891820 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.893017 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.893446 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.942991 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:47.945269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:47.951933 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f180cb92-3066-41ac-aeca-fe61ad0068e2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1682 microversion: 2.1 time: 0.224332 Aug 30 00:03:47.952510 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 291/603] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:47 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:48.028970 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:48.037837 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:48.039444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:48.040550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-15ba0349-2c4c-4319-b520-3c2891dc46ad tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.164891 Aug 30 00:03:48.041107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 313/604] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:47 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:03:48.973806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:48.974428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:48.981769 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:48.982251 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:48.982838 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:48.983549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:48.984003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:48.984478 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:49.063022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:49.063684 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:49.070211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:49.070731 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:49.071162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:49.071852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:49.072301 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:49.072721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:49.204179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:49.213082 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:49.214612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:49.215716 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b71a15b2-de46-4196-a8b3-f66b43368876 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.156564 Aug 30 00:03:49.216276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 314/605] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:49 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:03:49.377134 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:49.384988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-98991d78-a6e1-4161-a496-674bb12ebcc5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1682 microversion: 2.1 time: 0.415562 Aug 30 00:03:49.385562 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 292/606] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:48 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1682 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:50.014274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-8568cccf-6607-4eff-9105-e6d0931e0a6b req-060f6703-2d09-4c64-b631-24defd521959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2e61a5-53b5-471d-994c-e914bc29062c", "name": "network-vif-deleted", "tag": "087fef68-7393-41cd-a884-a680fa6b6d62"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:50.024874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-8568cccf-6607-4eff-9105-e6d0931e0a6b req-060f6703-2d09-4c64-b631-24defd521959 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:50.025329 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-8568cccf-6607-4eff-9105-e6d0931e0a6b req-060f6703-2d09-4c64-b631-24defd521959 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:50.025822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-8568cccf-6607-4eff-9105-e6d0931e0a6b req-060f6703-2d09-4c64-b631-24defd521959 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:50.038189 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-8568cccf-6607-4eff-9105-e6d0931e0a6b req-060f6703-2d09-4c64-b631-24defd521959 service nova] Creating event network-vif-deleted:087fef68-7393-41cd-a884-a680fa6b6d62 for instance 7d2e61a5-53b5-471d-994c-e914bc29062c on hv-cinder-85427 Aug 30 00:03:50.043131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-8568cccf-6607-4eff-9105-e6d0931e0a6b req-060f6703-2d09-4c64-b631-24defd521959 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032902 Aug 30 00:03:50.043710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 315/607] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:50.238490 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:50.239110 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:50.245357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:50.245844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:50.246267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:50.247013 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:50.247462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:50.247877 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:50.385859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:50.394717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:50.396255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:50.397461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-efffa96a-97dc-4756-9baf-59dd30ee1699 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.162941 Aug 30 00:03:50.398100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 293/608] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:50 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:50.407990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:50.408777 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:50.416360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:50.416870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:50.417297 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:50.418145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:50.418620 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:50.419040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:50.484229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:50.492173 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d98665c5-fac5-4e5e-8a92-1a472d3c37e9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1614 microversion: 2.1 time: 0.090655 Aug 30 00:03:50.492747 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 316/609] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:50 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:51.419751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:51.420270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:51.426696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:51.427171 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:51.427596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:51.428275 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:51.428727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:51.429142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:51.513593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:51.514197 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:51.525643 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:51.526845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:51.527423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:51.528598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:51.529918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:51.530626 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:51.570072 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:51.570740 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:51.571470 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:51.572139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'fault' on Instance uuid 7d2e61a5-53b5-471d-994c-e914bc29062c {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:03:51.577894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:51.578240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:51.587527 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:51.589361 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:51.590483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b6565f2b-0492-4982-9f75-5a84ed852fdf tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.174718 Aug 30 00:03:51.591359 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 294/610] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:51 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:51.616287 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:51.624426 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d4f7b87e-b38e-4ad8-b2bb-4937defbb75a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 200 len: 1331 microversion: 2.1 time: 0.114653 Aug 30 00:03:51.625014 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 317/611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:51 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:52.613784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:52.614384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:52.616234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:52.621446 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:52.621924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:52.622355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:52.623078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:52.623528 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:52.623947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:52.646912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:52.647429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:52.649278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:52.650063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=10 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:52.655706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:52.656190 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:52.656625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:52.657319 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:52.658285 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:52.658732 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:52.672131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c HTTP/1.1 Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:03:52.674388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:03:52.675951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '7d2e61a5-53b5-471d-994c-e914bc29062c'} Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:03:52.676760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:03:52.677923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:03:52.678998 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:03:52.678998 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-172f68aa-ea90-49c2-8c85-20db033d194b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 404 len: 111 microversion: 2.1 time: 0.033178 Aug 30 00:03:52.678998 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 318/612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:52 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:03:52.684743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f6d5da12-a12a-4d74-b9d8-3c6a81c7b191 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '.version_select at 0x7f09bf3f5280>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:52.755273 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:52.756638 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f6d5da12-a12a-4d74-b9d8-3c6a81c7b191 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482431715" status: 202 len: 0 microversion: 2.1 time: 0.075644 Aug 30 00:03:52.757440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 319/613] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Aug 30 00:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482431715 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:03:52.763855 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:52.765316 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:52.766502 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-406a74fb-efdc-4671-9bf0-848b908fb53f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.157155 Aug 30 00:03:52.767109 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 295/614] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:52 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:53.525532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:53.526024 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:53.533124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:53.533607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:53.534037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:53.534751 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:53.535199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:53.535620 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:53.687955 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'services' on Instance uuid a9105900-32ff-4338-bffd-cdf09407a6a6 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:03:53.720664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-ffa8381d-a16b-4afd-a263-48b2172a4d62 req-f2c96c5d-6a9e-40ff-9518-3ea2772ec304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0f865-8bd9-4058-93d8-be5258b0ffa0", "name": "network-vif-plugged", "status": "completed", "tag": "9971a71c-35a8-48ef-95f0-0729bcc06055"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:53.728689 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-ffa8381d-a16b-4afd-a263-48b2172a4d62 req-f2c96c5d-6a9e-40ff-9518-3ea2772ec304 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:53.729242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-ffa8381d-a16b-4afd-a263-48b2172a4d62 req-f2c96c5d-6a9e-40ff-9518-3ea2772ec304 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:53.729981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-ffa8381d-a16b-4afd-a263-48b2172a4d62 req-f2c96c5d-6a9e-40ff-9518-3ea2772ec304 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:53.744431 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-ffa8381d-a16b-4afd-a263-48b2172a4d62 req-f2c96c5d-6a9e-40ff-9518-3ea2772ec304 service nova] Creating event network-vif-plugged:9971a71c-35a8-48ef-95f0-0729bcc06055 for instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 on hv-cinder-85427 Aug 30 00:03:53.750254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-ffa8381d-a16b-4afd-a263-48b2172a4d62 req-f2c96c5d-6a9e-40ff-9518-3ea2772ec304 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035996 Aug 30 00:03:53.750691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 296/615] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:03:53.794949 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:53.795848 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:53.802209 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:53.802866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:53.803378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:53.804147 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:53.804658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:53.805273 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:53.931517 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9b7a55fb-6d9c-443d-9ccd-2acf6b16cda5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments/96d2cc13-2770-411e-82fe-2f79061706d2" status: 202 len: 0 microversion: 2.1 time: 0.409794 Aug 30 00:03:53.932726 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 320/616] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:03:53 2022] DELETE /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments/96d2cc13-2770-411e-82fe-2f79061706d2 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:03:53.941423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:53.948294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:53.950714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:53.952166 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:53.953384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8a716335-791f-4650-b3a5-f07c215afa56 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.162609 Aug 30 00:03:53.953985 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 297/617] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:53 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:53.955705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:53.964122 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:53.964617 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:53.965059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:53.965763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:53.966219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:53.966675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:54.006008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f12c7d52-14de-4716-8063-183d060b6984 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068582 Aug 30 00:03:54.010593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 321/618] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:03:53 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:03:54.976821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:54.977458 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:54.979930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:54.984953 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:54.985361 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:54.986504 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:54.992871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:54.992871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:54.992871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:55.018897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:55.023887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:55.027946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:55.028597 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:55.028847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:55.029540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:55.029991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:55.030411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:55.064491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-423f2595-444b-4e3e-8591-41dc00dacea5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049687 Aug 30 00:03:55.067251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 322/619] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:03:55 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:03:55.127192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:55.135492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:55.136955 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:55.138053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d418de21-2e34-444b-9441-7b796ea2ddfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1407 microversion: 2.20 time: 0.165191 Aug 30 00:03:55.138647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 298/620] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:54 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:56.076956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:56.079126 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:56.085447 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:56.085922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:56.086353 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:56.087066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:56.087517 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:56.087942 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:56.117302 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-cf9f817a-a0b3-4170-8929-71951bccdddf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Aug 30 00:03:56.117874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 323/621] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:03:56 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:56.161389 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:56.162002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:56.168439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:56.168911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:56.169349 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:56.170031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:56.170506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:56.170931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:56.301407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:56.309505 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:56.310977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:56.312124 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5c5e8f42-6146-4f2e-b84e-33dbf2520fe9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1598 microversion: 2.20 time: 0.154729 Aug 30 00:03:56.312681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 299/622] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:03:56 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:03:56.333661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:56.334145 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:56.340171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:56.340651 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:56.341089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:56.341774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:56.342231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:56.342687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:56.437415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-83d86476-12f5-4845-8de4-fa0af2763a35 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107561 Aug 30 00:03:56.438042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 324/623] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Aug 30 00:03:56 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:57.129964 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:57.132117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:57.138263 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:57.138776 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:57.139209 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:57.139895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:57.140346 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:57.140769 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:57.169875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-56c807be-f3f2-4b3e-9a8a-2b1b86ba35b8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044423 Aug 30 00:03:57.170461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 300/624] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:03:57 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:03:57.231638 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:57.232144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:57.238001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:57.238515 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:57.238954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:57.239641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:57.240091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:57.240511 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:57.266331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:03:57.560742 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c32d5496-eb51-4f7e-bf94-7797744d424a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 204 len: 0 microversion: 2.1 time: 0.333090 Aug 30 00:03:57.561327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 325/625] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:03:57 2022] DELETE /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:03:57.569908 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:57.570809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:57.576570 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:57.577054 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:57.577482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:57.578160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:57.578760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:57.579178 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:57.663403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-1d3e8255-15bb-4233-9c65-08b73d896e01 req-5103623c-b9df-4d43-a88e-d7e106770297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b0f865-8bd9-4058-93d8-be5258b0ffa0", "tag": "9971a71c-35a8-48ef-95f0-0729bcc06055"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:57.672919 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-1d3e8255-15bb-4233-9c65-08b73d896e01 req-5103623c-b9df-4d43-a88e-d7e106770297 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:57.673333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-1d3e8255-15bb-4233-9c65-08b73d896e01 req-5103623c-b9df-4d43-a88e-d7e106770297 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:57.674446 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-1d3e8255-15bb-4233-9c65-08b73d896e01 req-5103623c-b9df-4d43-a88e-d7e106770297 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:57.687475 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-1d3e8255-15bb-4233-9c65-08b73d896e01 req-5103623c-b9df-4d43-a88e-d7e106770297 service nova] Creating event network-changed:9971a71c-35a8-48ef-95f0-0729bcc06055 for instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 on hv-cinder-85427 Aug 30 00:03:57.693376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-1d3e8255-15bb-4233-9c65-08b73d896e01 req-5103623c-b9df-4d43-a88e-d7e106770297 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034068 Aug 30 00:03:57.694071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 326/626] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:57.721158 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:57.729014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a0506e96-225d-4b58-aec0-e50a753f35f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1682 microversion: 2.1 time: 0.162881 Aug 30 00:03:57.729594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 301/627] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:57 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:58.752819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:58.753551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:58.759937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:58.760415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:58.760848 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:58.761525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:58.761977 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:58.762397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:58.899225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:58.906892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-37c87f30-95ea-4ec5-b6ee-6e69e8c9b9b2 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1682 microversion: 2.1 time: 0.159333 Aug 30 00:03:58.907453 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 327/628] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:58 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:59.940948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:59.940948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:59.940948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:59.940948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:59.942135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:59.942135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:59.942135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:59.942135 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:00.293713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:00.308844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f8a07b40-7d34-4c77-89b7-5e75191e31d4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1682 microversion: 2.1 time: 0.383603 Aug 30 00:04:00.309452 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 302/629] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:59 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1682 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:00.785232 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-afc2aef0-c263-4d7b-b3b2-3383477ebedd req-69dbe672-68ec-40ce-9c14-48fa40227a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9105900-32ff-4338-bffd-cdf09407a6a6", "name": "network-vif-deleted", "tag": "2e3fc215-ce48-4169-86c0-77d59d94c4ab"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:00.796182 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-afc2aef0-c263-4d7b-b3b2-3383477ebedd req-69dbe672-68ec-40ce-9c14-48fa40227a79 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:00.796182 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-afc2aef0-c263-4d7b-b3b2-3383477ebedd req-69dbe672-68ec-40ce-9c14-48fa40227a79 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:00.796182 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-afc2aef0-c263-4d7b-b3b2-3383477ebedd req-69dbe672-68ec-40ce-9c14-48fa40227a79 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:00.806542 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-afc2aef0-c263-4d7b-b3b2-3383477ebedd req-69dbe672-68ec-40ce-9c14-48fa40227a79 service nova] Creating event network-vif-deleted:2e3fc215-ce48-4169-86c0-77d59d94c4ab for instance a9105900-32ff-4338-bffd-cdf09407a6a6 on hv-cinder-85427 Aug 30 00:04:00.811614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-afc2aef0-c263-4d7b-b3b2-3383477ebedd req-69dbe672-68ec-40ce-9c14-48fa40227a79 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030596 Aug 30 00:04:00.812216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 328/630] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:01.330542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:01.331715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:01.339269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:01.339802 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:01.340236 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:01.340932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:01.341638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:01.341795 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:01.375234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:01.375718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:01.376152 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:01.376596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'fault' on Instance uuid a9105900-32ff-4338-bffd-cdf09407a6a6 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:01.417404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:01.425623 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d2c13190-522b-49f6-b7c6-1e30331705d9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 200 len: 1332 microversion: 2.1 time: 0.099133 Aug 30 00:04:01.427637 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 303/631] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:01 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:02.447481 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:02.448229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:02.454354 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:02.454853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:02.455278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:02.455950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:02.456394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:02.456810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:02.469724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 HTTP/1.1 Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:04:02.471829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:04:02.473421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'a9105900-32ff-4338-bffd-cdf09407a6a6'} Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:04:02.474348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:04:02.476071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:02.477575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:04:02.477575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0f7b614e-ea8a-461d-bfb1-d985c108e510 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 404 len: 111 microversion: 2.1 time: 0.030419 Aug 30 00:04:02.477575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 329/632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:02 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:04:02.482376 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-002efc6b-0a0b-4d3d-9a9b-487e30811edf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '.version_select at 0x7f09bf55db80>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:02.589912 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-002efc6b-0a0b-4d3d-9a9b-487e30811edf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088556371" status: 202 len: 0 microversion: 2.1 time: 0.111432 Aug 30 00:04:02.590576 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 304/633] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 30 00:04:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088556371 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:04:03.524918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f06a665b-5164-44a3-9e30-66c27ca28e20 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: .version_select at 0x7f09bf26e820>, body: {"keypair": {"name": "tempest-keypair-1551860671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSybXv6rVcBtNRdIaYAkzheHfkIctvlJC7QoD8FBdiTkjkBdE4cTdEMATRrpgIRoY5T842eMrEygGzmPcPmMJabobBQHIBo5ZCfgvSdeng0cGMHdFLfXpF245l96ooq8Q=="}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:03.540867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-f06a665b-5164-44a3-9e30-66c27ca28e20 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:04:03.545111 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-f06a665b-5164-44a3-9e30-66c27ca28e20 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:04:03.561890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:03.641504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f06a665b-5164-44a3-9e30-66c27ca28e20 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120512 Aug 30 00:04:03.642124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 330/634] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:04:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:05.694026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1626264867", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb60052-2932-481b-a354-8ea27a27493d"}], "security_groups": [{"name": "tempest-securitygroup--1121180224"}], "key_name": "tempest-keypair-1551860671", "user_data": "}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:05.811270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] validate_networks() for [('ffb60052-2932-481b-a354-8ea27a27493d', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:04:06.189958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:04:06.190378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:04:06.190872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:04:06.191273 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:04:06.191677 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:04:06.200482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:06.200975 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:06.201424 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:06.202201 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:06.202702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:06.203122 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:06.219904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:04:06.223833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:04:06.234455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:04:06.236753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:04:06.380863 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-35593192-ac26-49ce-9e58-c59a44c27097 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691615 Aug 30 00:04:06.381454 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 305/635] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:04:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:04:06.393867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9ed021b0-ea2c-407f-829d-f20b06b2843d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:06.393867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9ed021b0-ea2c-407f-829d-f20b06b2843d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:06.453377 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9ed021b0-ea2c-407f-829d-f20b06b2843d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:06.460737 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9ed021b0-ea2c-407f-829d-f20b06b2843d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1242 microversion: 2.1 time: 0.072108 Aug 30 00:04:06.461306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 331/636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:06 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:07.481776 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:07.482321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:07.489940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:07.490500 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:07.494441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:07.494441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:07.494441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:07.494441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:07.561087 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:07.568799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6240d751-65b6-4453-afef-f2287e534a94 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1246 microversion: 2.1 time: 0.091731 Aug 30 00:04:07.569497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 306/637] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:07 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:08.589177 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:08.589791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:08.596237 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:08.596725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:08.597748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:08.598578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:08.598956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:08.599381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:08.665280 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:08.673653 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-324aba50-e24f-4ff6-b85d-05a2e7e9ff9c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1302 microversion: 2.1 time: 0.088249 Aug 30 00:04:08.674239 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 332/638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:08 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:09.694788 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:09.696008 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:09.701998 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:09.702581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:09.703077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:09.703847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:09.704357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:09.704839 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:09.899344 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:09.909426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c7a7f098-c474-4e73-abdb-b4fd93333686 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.217110 Aug 30 00:04:09.909426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 307/639] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:09 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:10.259006 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-5c3daa7f-8041-4f03-aa8c-8ba62eaa37f1 req-23223464-34c6-49df-924b-ce69ba8af0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365f024a-9d96-469a-99df-f5bb6ce93c3d", "tag": "84d8699b-b501-4b21-b4a5-60f1cc67f553"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:10.268728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-5c3daa7f-8041-4f03-aa8c-8ba62eaa37f1 req-23223464-34c6-49df-924b-ce69ba8af0d1 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:10.269705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-5c3daa7f-8041-4f03-aa8c-8ba62eaa37f1 req-23223464-34c6-49df-924b-ce69ba8af0d1 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:10.270144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-5c3daa7f-8041-4f03-aa8c-8ba62eaa37f1 req-23223464-34c6-49df-924b-ce69ba8af0d1 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:10.281228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-5c3daa7f-8041-4f03-aa8c-8ba62eaa37f1 req-23223464-34c6-49df-924b-ce69ba8af0d1 service nova] Creating event network-changed:84d8699b-b501-4b21-b4a5-60f1cc67f553 for instance 365f024a-9d96-469a-99df-f5bb6ce93c3d on hv-cinder-85427 Aug 30 00:04:10.287142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-5c3daa7f-8041-4f03-aa8c-8ba62eaa37f1 req-23223464-34c6-49df-924b-ce69ba8af0d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032246 Aug 30 00:04:10.287926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 333/640] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:10.929739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:10.930325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:10.937791 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:10.938271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:10.938921 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:10.939811 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:10.940262 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:10.940684 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:11.093730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:11.105037 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1f8ff0e4-758f-4591-9357-98459250d87e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.179235 Aug 30 00:04:11.110632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 308/641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:10 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:12.128106 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:12.128802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:12.138064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:12.138888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:12.139718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:12.140714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:12.141265 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:12.141718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:12.273964 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:12.281532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7a50608c-07d5-4e67-9245-0699dea0acd8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.158354 Aug 30 00:04:12.282083 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 334/642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:12 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:13.302346 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:13.302915 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:13.309288 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:13.309770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:13.310198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:13.310901 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:13.311350 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:13.311772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:13.436307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:13.448845 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1ac33c53-0f6b-46f2-9756-ac3e015d4cac tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.150042 Aug 30 00:04:13.449446 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 309/643] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:13 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:14.469274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:14.469857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:14.476388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:14.476863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:14.477293 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:14.477977 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:14.478429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:14.478874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:14.615671 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:14.623305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5c10cc20-d78d-4ede-91c7-c33fc6039142 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.157957 Aug 30 00:04:14.623900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 335/644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:14 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:15.644489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:15.645105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:15.651525 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:15.652009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:15.652521 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:15.653224 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:15.653708 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:15.654131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:15.668932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:15.788294 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:15.795861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a9a53636-6cd0-4aa1-982c-25eb00bbfa76 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.155215 Aug 30 00:04:15.796618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 310/645] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:15 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:15.827483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-76beaf84-e6db-40ac-a101-68cfae0f2787 req-d7e4bcb1-9e2f-45dd-a9c7-69574e4df765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365f024a-9d96-469a-99df-f5bb6ce93c3d", "name": "network-vif-plugged", "status": "completed", "tag": "84d8699b-b501-4b21-b4a5-60f1cc67f553"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:15.837537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-76beaf84-e6db-40ac-a101-68cfae0f2787 req-d7e4bcb1-9e2f-45dd-a9c7-69574e4df765 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:15.838054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-76beaf84-e6db-40ac-a101-68cfae0f2787 req-d7e4bcb1-9e2f-45dd-a9c7-69574e4df765 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:15.838498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-76beaf84-e6db-40ac-a101-68cfae0f2787 req-d7e4bcb1-9e2f-45dd-a9c7-69574e4df765 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:15.849693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-76beaf84-e6db-40ac-a101-68cfae0f2787 req-d7e4bcb1-9e2f-45dd-a9c7-69574e4df765 service nova] Creating event network-vif-plugged:84d8699b-b501-4b21-b4a5-60f1cc67f553 for instance 365f024a-9d96-469a-99df-f5bb6ce93c3d on hv-cinder-85427 Aug 30 00:04:15.854509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-76beaf84-e6db-40ac-a101-68cfae0f2787 req-d7e4bcb1-9e2f-45dd-a9c7-69574e4df765 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031108 Aug 30 00:04:15.855262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 336/646] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:16.816878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:16.817387 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:16.819237 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:16.823900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=6 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:16.825050 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:16.825520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:16.825945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:16.826646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:16.827107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:16.827501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:16.953765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:16.961880 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-56466443-d5ac-40aa-90f6-88c4c5343104 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.149127 Aug 30 00:04:16.962492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 311/647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:16 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:17.982942 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:17.983653 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:17.985711 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=6 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:17.991758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:17.992238 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:17.992717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:17.993406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:17.993871 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:17.994292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:18.130224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:18.138291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e3384a90-2141-4820-93b4-1c06a9cb7506 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1368 microversion: 2.1 time: 0.159658 Aug 30 00:04:18.138885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 337/648] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:17 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:19.159348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:19.160605 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:19.167190 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:19.167664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:19.168093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:19.168779 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:19.169229 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:19.169648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:19.298023 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:19.305613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dde1fe87-0473-4177-9e3b-a1e36d53d792 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1557 microversion: 2.1 time: 0.150131 Aug 30 00:04:19.306181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 312/649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:19 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:19.325328 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:19.325840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:19.332741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:19.333220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:19.333651 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:19.334334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:19.334810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:19.335235 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:19.409471 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7d68f386-a2b4-43f2-b07a-4755a8e0b194 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087908 Aug 30 00:04:19.410680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 338/650] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:04:19 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:20.405024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-9690e1f8-fbbf-4318-88ba-cdcb2174b1c3 req-50b250a5-4ba1-4126-975c-6ef5a5f7a6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365f024a-9d96-469a-99df-f5bb6ce93c3d", "tag": "84d8699b-b501-4b21-b4a5-60f1cc67f553"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:20.415781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9690e1f8-fbbf-4318-88ba-cdcb2174b1c3 req-50b250a5-4ba1-4126-975c-6ef5a5f7a6a9 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:20.416256 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9690e1f8-fbbf-4318-88ba-cdcb2174b1c3 req-50b250a5-4ba1-4126-975c-6ef5a5f7a6a9 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:20.416684 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9690e1f8-fbbf-4318-88ba-cdcb2174b1c3 req-50b250a5-4ba1-4126-975c-6ef5a5f7a6a9 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:20.428140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-9690e1f8-fbbf-4318-88ba-cdcb2174b1c3 req-50b250a5-4ba1-4126-975c-6ef5a5f7a6a9 service nova] Creating event network-changed:84d8699b-b501-4b21-b4a5-60f1cc67f553 for instance 365f024a-9d96-469a-99df-f5bb6ce93c3d on hv-cinder-85427 Aug 30 00:04:20.433201 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-9690e1f8-fbbf-4318-88ba-cdcb2174b1c3 req-50b250a5-4ba1-4126-975c-6ef5a5f7a6a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032107 Aug 30 00:04:20.434001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 313/651] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:21.634176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:21.636310 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:21.642240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:21.642757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:21.643197 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:21.643886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:21.644338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:21.644760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:21.660954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:21.676281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-58938ce0-6b06-4125-8df6-bd70d7ed77c6 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046765 Aug 30 00:04:21.676832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 339/652] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:04:21 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:04:21.740861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:21.741442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:21.748828 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:21.749240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:21.749666 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:21.750355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:21.750835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:21.751258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:21.782316 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:04:21.983818 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2b2dddf6-040b-4983-b444-96ad9bed28d1 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 204 len: 0 microversion: 2.1 time: 0.247652 Aug 30 00:04:21.984418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 314/653] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:04:21 2022] DELETE /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:04:21.993682 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:21.994293 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:22.000627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:22.001049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:22.001486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:22.002174 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:22.002669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:22.003104 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:22.143187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:22.151319 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-33a066e6-5402-44a6-88f3-dfae9ac4b987 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1673 microversion: 2.1 time: 0.161803 Aug 30 00:04:22.151883 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 340/654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:21 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:23.173780 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:23.174501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:23.181430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:23.181889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:23.182324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:23.183042 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:23.183493 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:23.183914 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:23.311499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:23.319277 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e7fd8a99-95f1-43f8-8d9b-d8c10f7a2207 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1673 microversion: 2.1 time: 0.149804 Aug 30 00:04:23.319853 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 315/655] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:23 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:24.340660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:24.341223 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:24.348465 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:24.348949 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:24.349392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:24.350092 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:24.350571 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:24.351000 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:24.489989 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:24.497735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6529f5d5-fb2f-4906-a1f5-9ade26e71422 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1673 microversion: 2.1 time: 0.161024 Aug 30 00:04:24.498288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 341/656] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:24 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:25.443388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-973fd89a-ae8f-4bd8-8413-647a55255a09 req-ea0111d3-f99d-4e49-a4cc-0cd99cf2d02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68880fbb-7000-4185-b41d-5b4241962ca9", "name": "network-vif-deleted", "tag": "dde5c265-f836-4880-9c73-bb362497cb0f"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:25.449471 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:25.454728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-973fd89a-ae8f-4bd8-8413-647a55255a09 req-ea0111d3-f99d-4e49-a4cc-0cd99cf2d02b service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:25.455213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-973fd89a-ae8f-4bd8-8413-647a55255a09 req-ea0111d3-f99d-4e49-a4cc-0cd99cf2d02b service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:25.455641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-973fd89a-ae8f-4bd8-8413-647a55255a09 req-ea0111d3-f99d-4e49-a4cc-0cd99cf2d02b service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:25.466812 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-973fd89a-ae8f-4bd8-8413-647a55255a09 req-ea0111d3-f99d-4e49-a4cc-0cd99cf2d02b service nova] Creating event network-vif-deleted:dde5c265-f836-4880-9c73-bb362497cb0f for instance 68880fbb-7000-4185-b41d-5b4241962ca9 on hv-cinder-85427 Aug 30 00:04:25.471887 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-973fd89a-ae8f-4bd8-8413-647a55255a09 req-ea0111d3-f99d-4e49-a4cc-0cd99cf2d02b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Aug 30 00:04:25.473227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 316/657] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:25.519337 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:25.519874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:25.526342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:25.526868 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:25.527305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:25.535081 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:25.535081 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:25.535081 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:25.601296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:25.609359 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aaff1449-db33-4ea9-92ef-48e70293dbf9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1605 microversion: 2.1 time: 0.094152 Aug 30 00:04:25.610178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 342/658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:25 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1605 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:25.963695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:25.964270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:25.972816 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:25.972816 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:25.973348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:25.973540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:25.973987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:25.974407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.070835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lazy-loading 'services' on Instance uuid 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:26.272858 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d048e893-324b-4662-836e-122c64d3ed18 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "DELETE /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments/27a95b92-c72a-4930-87b4-e48e03f46421" status: 202 len: 0 microversion: 2.1 time: 0.313215 Aug 30 00:04:26.273462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 317/659] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:04:25 2022] DELETE /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments/27a95b92-c72a-4930-87b4-e48e03f46421 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:04:26.281797 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:26.284459 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:26.290457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.291069 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.291511 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.292281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.292730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.293351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.327548 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-55069f40-8126-44b3-9e5b-ef97be4eb626 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049451 Aug 30 00:04:26.328187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 343/660] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:04:26 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:26.633715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:26.634437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:26.641122 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.641595 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.642021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.642726 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.643165 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.643577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.673407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:26.673871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:26.674294 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:26.674753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lazy-loading 'fault' on Instance uuid 68880fbb-7000-4185-b41d-5b4241962ca9 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:26.715047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:26.722623 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8b670e49-cf13-4fbb-a66f-0e244d8967fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 200 len: 1326 microversion: 2.1 time: 0.094439 Aug 30 00:04:26.723187 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 318/661] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:26 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:27.340378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:27.343060 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:27.349408 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:27.349886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:27.350319 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:27.351040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:27.351495 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:27.351915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:27.382131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-24d8e366-94b4-4ba1-8bce-f85fd974ca78 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Aug 30 00:04:27.382728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 344/662] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:04:27 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:04:27.744457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:27.744875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:27.751400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:27.751872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:27.752298 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:27.752974 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:27.753423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:27.753845 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:27.767151 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] HTTP exception thrown: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Request method failure captured: Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 HTTP/1.1 Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLzymYp0clIGGbeaSuCTTtb8tPNS2ArypM_izntymF2j0kQ2seHdfZCncpB1nbZ8_yWLe-HQLg85VN_cPaqjN49lKJR1jC8Vxld9pZtG2V0YyNKSR_xVsha2kfJkmjM6Ff_2KnJZXqDdW1BEIhUX8aD6l1hq1JzGsB2mqds_pKqi2s Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:04:27.768742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}] Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 3f27121b3ab54d5194dedcbe4b112727 Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:04:27.770184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '68880fbb-7000-4185-b41d-5b4241962ca9'} Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:04:27.771028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:04:27.772241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:04:27.773312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Returning 404 to user: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:04:27.773312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-aa61bcda-f6d1-408f-aff2-fc2ed55160d0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 404 len: 111 microversion: 2.1 time: 0.030021 Aug 30 00:04:27.773312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 319/663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:27 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:04:27.779107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-830bd9b0-7cdd-4ebf-9ab8-ac849f42cb19 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '.version_select at 0x7f09bf2c7f70>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:27.852759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-830bd9b0-7cdd-4ebf-9ab8-ac849f42cb19 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833504788" status: 202 len: 0 microversion: 2.1 time: 0.077524 Aug 30 00:04:27.853333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 345/664] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 30 00:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833504788 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:04:28.394764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:28.397628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:28.403699 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.404191 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.404627 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:28.405327 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.405788 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.406206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:28.437653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8486fdf0-be4c-40db-bec5-fda62425cc2b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046837 Aug 30 00:04:28.438128 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 320/665] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:04:28 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:04:28.513586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:28.514095 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:28.521310 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.521821 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.522299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:28.523023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.523507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.523930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:28.550428 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:04:28.559182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-30d98c8b-ba1b-4523-9fcd-6133dab2face tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'create', calling method: .version_select at 0x7f09bf274040>, body: {"keypair": {"name": "tempest-keypair-1817054252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDvFRSfp9SmU7/ThoPtO2hUQySGegajaka0LyqcoWH3EtjT14e+Wcnsu+9K0qBVP/L1kXxMDt5xHi8Blj3y9LMZNMlHYbhgwq8vrZu21QWY4HZXZdwbNmm+NsWipbxIPw=="}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:28.577789 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-30d98c8b-ba1b-4523-9fcd-6133dab2face tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:04:28.582039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-30d98c8b-ba1b-4523-9fcd-6133dab2face tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for user 3f27121b3ab54d5194dedcbe4b112727 and project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:04:28.693730 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-30d98c8b-ba1b-4523-9fcd-6133dab2face tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138203 Aug 30 00:04:28.694246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 321/666] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:04:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:04:28.796660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-638393c1-b914-4179-b9cc-f1d8a82d8130 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "DELETE /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 204 len: 0 microversion: 2.1 time: 0.286440 Aug 30 00:04:28.797269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 346/667] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:04:28 2022] DELETE /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:04:28.806225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:28.806887 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:28.812992 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.813487 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.813901 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:28.814629 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:28.815185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:28.815525 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:28.978850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:28.986665 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ed5eb4a8-7da0-4820-b639-84e854e4de32 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1686 microversion: 2.1 time: 0.185246 Aug 30 00:04:28.987231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 322/668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:28 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:30.010157 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:30.011775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:30.018255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:30.024178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:30.024178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:30.024178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:30.024178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:30.024687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:30.209102 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:30.216971 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-bb522299-e22d-4366-9e28-cb4a632f614f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1686 microversion: 2.1 time: 0.212283 Aug 30 00:04:30.217541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 347/669] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:30 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1686 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:30.705009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-581776492", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1daca9fc-b41f-47af-b248-ac12ba6e5bb7"}], "security_groups": [{"name": "tempest-securitygroup--664013546"}], "key_name": "tempest-keypair-1817054252", "user_data": "}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:30.806629 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] validate_networks() for [('1daca9fc-b41f-47af-b248-ac12ba6e5bb7', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:04:31.167596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:04:31.168015 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:04:31.168488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:04:31.168889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:04:31.169289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:04:31.178186 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:31.178715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:31.179145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:31.179860 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:31.180314 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:31.180785 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:31.200467 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:04:31.204478 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Getting quotas for user 3f27121b3ab54d5194dedcbe4b112727 and project 9b2a9053ef0c4083a5c8afbfcb7bb3c9. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:04:31.215604 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:04:31.217853 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:04:31.246518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:31.246518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:31.249737 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:31.250218 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:31.250709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:31.251376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:31.251833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:31.252255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:31.368587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1d1ba535-8c17-4f8c-a99b-0d21509a47f9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667779 Aug 30 00:04:31.369560 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 323/670] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:04:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:04:31.379639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:31.380466 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-450c0b8f-f408-4e4d-bdda-5c66726c985e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:31.381183 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-450c0b8f-f408-4e4d-bdda-5c66726c985e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:31.389722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-46bbe8f7-4850-4e6e-8fdc-0e9f04099bc2 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1686 microversion: 2.1 time: 0.150454 Aug 30 00:04:31.390628 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 348/671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:31 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:31.435102 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-450c0b8f-f408-4e4d-bdda-5c66726c985e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:31.441868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-450c0b8f-f408-4e4d-bdda-5c66726c985e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1237 microversion: 2.1 time: 0.065536 Aug 30 00:04:31.443044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 324/672] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:31 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:32.411248 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:32.411866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:32.418244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:32.418767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:32.419242 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:32.422759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:32.422759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:32.422759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:32.463359 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:32.463962 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:32.470113 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:32.470631 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:32.471058 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:32.471752 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:32.472202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:32.472622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:32.558724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:32.566995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8a073f95-c451-496e-accc-4ad5f9d3aa1c tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1686 microversion: 2.1 time: 0.160204 Aug 30 00:04:32.567636 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 349/673] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:32 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:32.603905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:32.612079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0e11b77b-3749-4f51-b31c-badd55a89aa4 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1241 microversion: 2.1 time: 0.152665 Aug 30 00:04:32.612675 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 325/674] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:32 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:33.429980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-f61344e3-c3bd-4b3d-b920-b47f74fbabea req-6cfbadbb-b30b-4243-86bd-647c34b42c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd", "name": "network-vif-deleted", "tag": "95eb0348-4d8c-4314-b169-75e6e905f723"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:33.439574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f61344e3-c3bd-4b3d-b920-b47f74fbabea req-6cfbadbb-b30b-4243-86bd-647c34b42c8b service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:33.440057 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f61344e3-c3bd-4b3d-b920-b47f74fbabea req-6cfbadbb-b30b-4243-86bd-647c34b42c8b service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:33.441792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-f61344e3-c3bd-4b3d-b920-b47f74fbabea req-6cfbadbb-b30b-4243-86bd-647c34b42c8b service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:33.453454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-f61344e3-c3bd-4b3d-b920-b47f74fbabea req-6cfbadbb-b30b-4243-86bd-647c34b42c8b service nova] Creating event network-vif-deleted:95eb0348-4d8c-4314-b169-75e6e905f723 for instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd on hv-cinder-85427 Aug 30 00:04:33.459805 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-f61344e3-c3bd-4b3d-b920-b47f74fbabea req-6cfbadbb-b30b-4243-86bd-647c34b42c8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Aug 30 00:04:33.461073 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 350/675] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:04:33.588164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:33.588782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:33.602696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:33.603478 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:33.604705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:33.605579 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:33.606045 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:33.606499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:33.654594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:33.656124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:33.664486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:33.665983 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:33.666861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:33.668579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:33.669324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:33.669977 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:33.745622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:33.754269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b087300f-a65d-4df3-9507-55a079d38e1e tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1329 microversion: 2.1 time: 0.169990 Aug 30 00:04:33.758635 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:33.767722 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 326/676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:33 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1329 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:33.768261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-02e20d25-706c-4b9b-a4d5-14b7764d201c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1297 microversion: 2.1 time: 0.138193 Aug 30 00:04:33.773928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 351/677] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:33 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1297 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:34.777067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:34.777652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:34.784462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:34.784937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:34.785399 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:34.786697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:34.790573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:34.790573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:34.793611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:34.794365 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:34.802191 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:34.802963 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:34.803559 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:34.804465 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:34.805028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:34.805547 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:34.825522 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:34.826182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:34.826750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:34.827281 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lazy-loading 'fault' on Instance uuid 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:34.881243 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:34.897644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-42dd4fbd-c2a2-4b9d-b5cb-3f5f247f1a15 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 200 len: 1334 microversion: 2.1 time: 0.124361 Aug 30 00:04:34.898895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 327/678] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:34 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 1334 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:34.961188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:34.969003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d350cda8-af77-4b62-a241-35e3a851149f tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.179560 Aug 30 00:04:34.969573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 352/679] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:34 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:35.491936 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-6d80cf68-04d8-4934-81db-9d03f4fa06ae req-922ef097-b195-4cd8-a639-6e06b5af54ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1e8890-dd0e-46f4-88c0-448632b42a35", "tag": "949b050f-eda4-4836-844b-e0fb6a44df8a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:35.501516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-6d80cf68-04d8-4934-81db-9d03f4fa06ae req-922ef097-b195-4cd8-a639-6e06b5af54ca service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:35.502162 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-6d80cf68-04d8-4934-81db-9d03f4fa06ae req-922ef097-b195-4cd8-a639-6e06b5af54ca service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:35.502622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-6d80cf68-04d8-4934-81db-9d03f4fa06ae req-922ef097-b195-4cd8-a639-6e06b5af54ca service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:35.513831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-6d80cf68-04d8-4934-81db-9d03f4fa06ae req-922ef097-b195-4cd8-a639-6e06b5af54ca service nova] Creating event network-changed:949b050f-eda4-4836-844b-e0fb6a44df8a for instance dd1e8890-dd0e-46f4-88c0-448632b42a35 on hv-cinder-85427 Aug 30 00:04:35.519243 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-6d80cf68-04d8-4934-81db-9d03f4fa06ae req-922ef097-b195-4cd8-a639-6e06b5af54ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031482 Aug 30 00:04:35.519875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 328/680] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:35.920442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:35.921040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:35.927770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:35.928141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:35.929267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:35.929267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:35.930451 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:35.930451 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:35.944076 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] HTTP exception thrown: Instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd could not be found. Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Request method failure captured: Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd HTTP/1.1 Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLqpgnE_Ii-S0Ne3Nsfgbd6JBmuliRuSshaGbLD5BOvWn30wij20w9qsKcR37vZB8fQAPEAA2E90vUrUAMDGzq_dBiWr5GoRvMro0QKlSEsyvAy3pEzbh8pz9RNTkvlj0eUgF0x4KUqWetwmdI46ldVB-vEV1KhwJH--SzNfuJ376I Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:04:35.945683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}] Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: e0a5a4228c5d41c7898aa768dfe359ca Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd could not be found. Aug 30 00:04:35.947404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd'} Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd could not be found. Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:04:35.948292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd could not be found. Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd could not be found. Aug 30 00:04:35.949887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:35.951333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Returning 404 to user: Instance 47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:04:35.951333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-83c5f2d6-ee08-4a9a-9ffc-c16a549ba55b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd" status: 404 len: 111 microversion: 2.1 time: 0.030653 Aug 30 00:04:35.951333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 353/681] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:35 2022] GET /compute/v2.1/servers/47ee2c6b-d9d2-4c67-9d36-15b52ba56fcd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:04:35.956813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b28a0734-5677-48fd-b442-5d393f1b0cfc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '.version_select at 0x7f09bf2570d0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:35.991424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:35.992020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:35.998099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:35.998653 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:35.999165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:35.999840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:36.000288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:36.000706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:36.087859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b28a0734-5677-48fd-b442-5d393f1b0cfc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452332878" status: 202 len: 0 microversion: 2.1 time: 0.135544 Aug 30 00:04:36.088453 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 329/682] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 30 00:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452332878 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:04:36.131623 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:36.139457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8b964dfd-971d-40bf-a981-58df8c4e5ba9 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.151947 Aug 30 00:04:36.140019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 354/683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:35 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:04:37.162454 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:37.164446 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:37.171994 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:37.172586 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:37.174230 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:37.178714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:37.179234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:37.182073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:37.201296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:37.392664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:37.400308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5ed8ad10-de09-422a-95ad-52c3ae9cc26b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.243011 Aug 30 00:04:37.400889 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 330/684] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:37 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:38.421093 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:38.421690 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:38.424041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:38.429401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:38.429880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:38.430314 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:38.431032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:38.431485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:38.431909 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:38.565282 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:38.572839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e748dd8c-2ac5-4278-a0d0-848dacc721f3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.155701 Aug 30 00:04:38.573404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 355/685] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:38 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:39.594289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:39.594946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:39.602285 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:39.602800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:39.603227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:39.603931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:39.604373 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:39.604803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:39.734605 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:39.742206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-69b04178-f62d-4f3f-a5aa-826519717380 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.151876 Aug 30 00:04:39.742917 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 331/686] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:39 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:39.776891 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:39.777392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:39.783672 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:39.784176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:39.784617 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:39.785307 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:39.785764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:39.786189 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:39.810414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:04:39.813154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:39.922156 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-29f4ea81-8eba-4f20-9083-ab1def472dad req-30cef785-bfa3-45d0-89ed-12debdb28898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e8890-dd0e-46f4-88c0-448632b42a35", "name": "network-vif-plugged", "status": "completed", "tag": "949b050f-eda4-4836-844b-e0fb6a44df8a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:39.931663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-29f4ea81-8eba-4f20-9083-ab1def472dad req-30cef785-bfa3-45d0-89ed-12debdb28898 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:39.932145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-29f4ea81-8eba-4f20-9083-ab1def472dad req-30cef785-bfa3-45d0-89ed-12debdb28898 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:39.932570 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-29f4ea81-8eba-4f20-9083-ab1def472dad req-30cef785-bfa3-45d0-89ed-12debdb28898 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:39.944098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-29f4ea81-8eba-4f20-9083-ab1def472dad req-30cef785-bfa3-45d0-89ed-12debdb28898 service nova] Creating event network-vif-plugged:949b050f-eda4-4836-844b-e0fb6a44df8a for instance dd1e8890-dd0e-46f4-88c0-448632b42a35 on hv-cinder-85427 Aug 30 00:04:39.948905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-29f4ea81-8eba-4f20-9083-ab1def472dad req-30cef785-bfa3-45d0-89ed-12debdb28898 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Aug 30 00:04:39.949502 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 332/687] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:04:40.114783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7ef11da7-1828-4a74-b023-dab61cc0539f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 204 len: 0 microversion: 2.1 time: 0.341745 Aug 30 00:04:40.116776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 356/688] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:04:39 2022] DELETE /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:04:40.124504 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:40.128566 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:40.131900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:40.132515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:40.132816 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:40.133758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:40.134217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:40.134767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:40.266141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:40.273854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bef9b3cc-ede2-487c-9521-26178de6d84f tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1508 microversion: 2.1 time: 0.153529 Aug 30 00:04:40.274359 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 333/689] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:40 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:40.763741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:40.764454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:40.770360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:40.770890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:40.771328 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:40.772521 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:40.772974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:40.773407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:40.911213 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:40.911862 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c8a9c780-503f-45b4-89ff-4bc64b91141c tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.152368 Aug 30 00:04:40.913082 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 357/690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:40 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:41.294697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:41.295394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:41.297753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:41.302736 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:41.303228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:41.303660 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:41.304404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:41.304859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:41.305283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:41.432996 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:41.438681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=12 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:41.441507 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2c71b9a5-3ad3-4c90-8dc4-75b4714a108b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1508 microversion: 2.1 time: 0.150687 Aug 30 00:04:41.444537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 334/691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:41 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:41.934054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:41.934706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:41.941223 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:41.941821 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:41.942144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:41.942857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:41.943313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:41.943738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:42.074284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:42.082392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7e6a7cbc-e3be-4e1f-b75a-bd05cc7ca51e tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.152302 Aug 30 00:04:42.082981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 358/692] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:41 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:42.463412 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:42.464017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:42.470505 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:42.470988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:42.471418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:42.472138 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:42.472591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:42.473017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:42.600254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:42.607820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4d37bd0e-295a-4748-90f6-e890937c3290 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1508 microversion: 2.1 time: 0.148662 Aug 30 00:04:42.608396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 335/693] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:42 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:43.104140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:43.104749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:43.111260 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:43.111739 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:43.112199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:43.112887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:43.113340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:43.113764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:43.241004 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:43.248648 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-92e2f3ee-65e1-40f1-8924-bfd1ba716bb0 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.149025 Aug 30 00:04:43.249207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 359/694] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:43 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:43.411380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-f84ffc13-1f73-4b82-9e27-76c3207c3e83 req-048098d6-66d9-49e3-97fc-5da7f7e8d42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acc0a09-67e0-4d32-9078-cef31f93aaa2", "name": "network-vif-deleted", "tag": "bde78a3d-e8ef-49e0-83b4-e3f38628717b"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:43.426300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f84ffc13-1f73-4b82-9e27-76c3207c3e83 req-048098d6-66d9-49e3-97fc-5da7f7e8d42f service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:43.427087 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f84ffc13-1f73-4b82-9e27-76c3207c3e83 req-048098d6-66d9-49e3-97fc-5da7f7e8d42f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:43.434173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f84ffc13-1f73-4b82-9e27-76c3207c3e83 req-048098d6-66d9-49e3-97fc-5da7f7e8d42f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:43.440530 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-f84ffc13-1f73-4b82-9e27-76c3207c3e83 req-048098d6-66d9-49e3-97fc-5da7f7e8d42f service nova] Creating event network-vif-deleted:bde78a3d-e8ef-49e0-83b4-e3f38628717b for instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 on hv-cinder-85427 Aug 30 00:04:43.445687 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-f84ffc13-1f73-4b82-9e27-76c3207c3e83 req-048098d6-66d9-49e3-97fc-5da7f7e8d42f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041315 Aug 30 00:04:43.446668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 336/695] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:04:43.638227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:43.638953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:43.645455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:43.646219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:43.646894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:43.647883 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:43.648405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:43.649064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:43.721627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:43.730194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3ea55730-ca8d-4e49-bf34-2afae4d75b1d tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1293 microversion: 2.1 time: 0.096158 Aug 30 00:04:43.730808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 360/696] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:43 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:44.137167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:44.138058 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:44.144114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:44.151004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:44.151004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:44.151004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:44.151004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:44.151387 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:44.170047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2d3b4c13-5ee1-4252-8466-0a0fca9fe854 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/ips" status: 200 len: 150 microversion: 2.20 time: 0.093885 Aug 30 00:04:44.170624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 337/697] 10.222.0.60 () {60 vars in 1289 bytes} [Tue Aug 30 00:04:44 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:04:44.273882 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:44.274636 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:44.282090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:44.282688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:44.283308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:44.284241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:44.284696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:44.285285 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:44.423018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:44.430709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a971fe04-bf94-41ca-bc51-aacbb3ef9b84 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1362 microversion: 2.1 time: 0.164625 Aug 30 00:04:44.431281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 361/698] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:44 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:44.751245 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:44.751850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:44.759032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:44.759699 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:44.760034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:44.760722 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:44.761164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:44.761652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:44.794961 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:44.795855 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:44.796445 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:44.796573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lazy-loading 'fault' on Instance uuid 9acc0a09-67e0-4d32-9078-cef31f93aaa2 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:44.843618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:44.848009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5d34a72d-2b2d-4ec0-88f8-37d59ef575bb tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 200 len: 1312 microversion: 2.1 time: 0.100476 Aug 30 00:04:44.848585 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 338/699] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:44 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:45.452074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:45.452664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:45.459479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.468557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.468557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.468557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.468557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.468922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.589590 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:45.597454 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7fb99e7e-c029-4251-b284-c8c9e6ef9246 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1548 microversion: 2.1 time: 0.149262 Aug 30 00:04:45.598094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 362/700] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:45 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:45.618081 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:45.618636 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:45.624919 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.625396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.625872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.626582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.627033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.629036 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.702517 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ccd25ba8-42f0-4b1c-9f2f-b79912af3f59 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088743 Aug 30 00:04:45.703118 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 339/701] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:04:45 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:45.868979 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:45.869500 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 9acc0a09-67e0-4d32-9078-cef31f93aaa2] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:45.875570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.876052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.876483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.877176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.877624 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.878043 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.892470 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] HTTP exception thrown: Instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 could not be found. Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Request method failure captured: Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 HTTP/1.1 Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLqpgnE_Ii-S0Ne3Nsfgbd6JBmuliRuSshaGbLD5BOvWn30wij20w9qsKcR37vZB8fQAPEAA2E90vUrUAMDGzq_dBiWr5GoRvMro0QKlSEsyvAy3pEzbh8pz9RNTkvlj0eUgF0x4KUqWetwmdI46ldVB-vEV1KhwJH--SzNfuJ376I Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:04:45.894396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}] Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: e0a5a4228c5d41c7898aa768dfe359ca Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 could not be found. Aug 30 00:04:45.895956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '9acc0a09-67e0-4d32-9078-cef31f93aaa2'} Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 could not be found. Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:04:45.897414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 could not be found. Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 could not be found. Aug 30 00:04:45.898842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:45.900089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Returning 404 to user: Instance 9acc0a09-67e0-4d32-9078-cef31f93aaa2 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:04:45.900089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ae9f33af-311a-4168-8576-1527780c0248 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2" status: 404 len: 111 microversion: 2.1 time: 0.030841 Aug 30 00:04:45.900089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 363/702] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:45 2022] GET /compute/v2.1/servers/9acc0a09-67e0-4d32-9078-cef31f93aaa2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:04:45.905300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:45.905828 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:45.911800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.912280 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.912706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.913387 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:45.913835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:45.914249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:45.938544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:04:46.241132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-310ff4e7-cd1f-4b51-8342-6442c8824f0b tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 204 len: 0 microversion: 2.1 time: 0.338839 Aug 30 00:04:46.241734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 340/703] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:04:45 2022] DELETE /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:04:46.249641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:46.250247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:46.256861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.257345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.257780 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.258749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.259201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.259630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.290728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:46.291377 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:46.297724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.298338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.298800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.299494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.299978 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.300350 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.324859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lazy-loading 'flavor' on Instance uuid 22b0f865-8bd9-4058-93d8-be5258b0ffa0 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:46.398990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:46.406915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8e38bc96-1a69-4311-bbc0-25c61f122614 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.161011 Aug 30 00:04:46.407482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 364/704] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:46 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:46.712119 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-d0055a63-8461-49a4-9afd-035a8f611133 req-f3fb7b73-c47f-4390-a7e6-748979f57de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1e8890-dd0e-46f4-88c0-448632b42a35", "tag": "949b050f-eda4-4836-844b-e0fb6a44df8a"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:46.722566 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-d0055a63-8461-49a4-9afd-035a8f611133 req-f3fb7b73-c47f-4390-a7e6-748979f57de4 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.723035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-d0055a63-8461-49a4-9afd-035a8f611133 req-f3fb7b73-c47f-4390-a7e6-748979f57de4 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.723460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-d0055a63-8461-49a4-9afd-035a8f611133 req-f3fb7b73-c47f-4390-a7e6-748979f57de4 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.735180 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-d0055a63-8461-49a4-9afd-035a8f611133 req-f3fb7b73-c47f-4390-a7e6-748979f57de4 service nova] Creating event network-changed:949b050f-eda4-4836-844b-e0fb6a44df8a for instance dd1e8890-dd0e-46f4-88c0-448632b42a35 on hv-cinder-85427 Aug 30 00:04:46.739982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-d0055a63-8461-49a4-9afd-035a8f611133 req-f3fb7b73-c47f-4390-a7e6-748979f57de4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031633 Aug 30 00:04:46.741173 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 365/705] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:46.767406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8b9ea585-39f3-40e6-8ee8-7f51903b0ed4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/action" status: 202 len: 0 microversion: 2.20 time: 0.480822 Aug 30 00:04:46.771931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 341/706] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 30 00:04:46 2022] POST /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 00:04:46.777804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:46.778554 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:46.785068 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.785671 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.786172 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.787003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:46.788058 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:46.788582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:46.918360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:46.926706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:46.928181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:46.929350 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e6cf3e73-3c6b-49f2-9be2-2e8ee0f5832f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.155869 Aug 30 00:04:46.929947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 366/707] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:46 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:04:47.429381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:47.430001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:47.436495 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:47.437004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:47.437436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:47.438121 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:47.438645 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:47.439021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:47.578266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:47.586229 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9244b82f-d246-4265-b64d-f3758c8c56a7 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.161507 Aug 30 00:04:47.591704 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 342/708] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:47 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:47.953096 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:47.953738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:47.960667 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:47.961151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:47.961588 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:47.962280 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:47.962757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:47.963183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:48.096859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:48.104912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:48.106347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:48.107636 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f7efe993-0902-43ef-b227-87a2fc91e17f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.158435 Aug 30 00:04:48.108195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 367/709] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:47 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:48.607269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:48.607979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:48.614346 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:48.614854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:48.615846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:48.616532 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:48.616987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:48.617440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:48.747016 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:48.754625 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f11b8043-176a-4758-b173-1a204b4b9cef tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.151304 Aug 30 00:04:48.755191 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 343/710] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:48 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:49.130355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:49.131669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:49.138298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:49.138804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:49.139232 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:49.139905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:49.140413 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:49.140922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:49.274056 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:49.282342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:49.283825 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:49.284984 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8e40a276-6bd8-425a-8c7b-b37249e503e0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.158511 Aug 30 00:04:49.288732 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 368/711] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:49 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:49.775695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:49.776591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:49.783419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:49.784013 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:49.784517 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:49.785285 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:49.785810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:49.786298 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:50.143396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:50.151603 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-da4b013e-db12-4385-9a2b-d55b2cdc2440 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1521 microversion: 2.1 time: 0.380335 Aug 30 00:04:50.152172 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 344/712] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:49 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:50.308452 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:50.309091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:50.316084 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:50.316643 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:50.317152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:50.317913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:50.318909 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:50.319338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:50.450355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:50.459586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:50.461064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:50.462217 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-83323936-1330-4b5e-a650-5992eb79f002 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.157717 Aug 30 00:04:50.462812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 369/713] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:50 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:50.634398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-0f7a7570-b353-4a9a-aa61-c9edfd122ae2 req-d536d2be-c20a-4f09-b76f-5ea30a315bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df5b062-9099-42fa-9bcc-40d56163ce2b", "name": "network-vif-deleted", "tag": "8816fffa-9f4f-44df-9179-ead1fe82bcc3"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:04:50.639802 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:50.644999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0f7a7570-b353-4a9a-aa61-c9edfd122ae2 req-d536d2be-c20a-4f09-b76f-5ea30a315bba service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:50.645463 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0f7a7570-b353-4a9a-aa61-c9edfd122ae2 req-d536d2be-c20a-4f09-b76f-5ea30a315bba service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:50.645882 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0f7a7570-b353-4a9a-aa61-c9edfd122ae2 req-d536d2be-c20a-4f09-b76f-5ea30a315bba service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:50.648459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:50.659638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-0f7a7570-b353-4a9a-aa61-c9edfd122ae2 req-d536d2be-c20a-4f09-b76f-5ea30a315bba service nova] Creating event network-vif-deleted:8816fffa-9f4f-44df-9179-ead1fe82bcc3 for instance 3df5b062-9099-42fa-9bcc-40d56163ce2b on hv-cinder-85427 Aug 30 00:04:50.664633 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-0f7a7570-b353-4a9a-aa61-c9edfd122ae2 req-d536d2be-c20a-4f09-b76f-5ea30a315bba service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Aug 30 00:04:50.665214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 345/714] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:04:51.172848 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:51.173387 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:51.179914 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:51.180388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:51.180816 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:51.181534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:51.181974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:51.182388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:51.213219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:51.213700 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:51.214135 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:51.216229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lazy-loading 'fault' on Instance uuid 3df5b062-9099-42fa-9bcc-40d56163ce2b {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:04:51.259447 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a5a4228c5d41c7898aa768dfe359ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6a508fae014aeb8e7d97b74e3071a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:51.267136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fed277fb-4dde-42c8-956e-09ec84ae6136 tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 200 len: 1312 microversion: 2.1 time: 0.098162 Aug 30 00:04:51.267702 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 370/715] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:51 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:04:51.485419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:51.486101 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:51.494055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:51.496751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:51.496751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:51.496751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:51.496751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:51.497161 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:51.629864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:51.639139 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:51.641503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:51.641927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bffe8a1d-52a9-4f1c-8a4f-22f08c4d4035 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.160583 Aug 30 00:04:51.642507 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 346/716] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:51 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:52.288913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:52.289510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] [instance: 3df5b062-9099-42fa-9bcc-40d56163ce2b] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:52.295950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:52.296603 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:52.296978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:52.297575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:52.298026 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:52.298444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:52.312281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] HTTP exception thrown: Instance 3df5b062-9099-42fa-9bcc-40d56163ce2b could not be found. Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Request method failure captured: Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b HTTP/1.1 Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLqpgnE_Ii-S0Ne3Nsfgbd6JBmuliRuSshaGbLD5BOvWn30wij20w9qsKcR37vZB8fQAPEAA2E90vUrUAMDGzq_dBiWr5GoRvMro0QKlSEsyvAy3pEzbh8pz9RNTkvlj0eUgF0x4KUqWetwmdI46ldVB-vEV1KhwJH--SzNfuJ376I Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:04:52.313928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9d6a508fae014aeb8e7d97b74e3071a4"}]}] Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 9d6a508fae014aeb8e7d97b74e3071a4 Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2011120560 Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: e0a5a4228c5d41c7898aa768dfe359ca Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2011120560-project Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 3df5b062-9099-42fa-9bcc-40d56163ce2b could not be found. Aug 30 00:04:52.315557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '3df5b062-9099-42fa-9bcc-40d56163ce2b'} Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df5b062-9099-42fa-9bcc-40d56163ce2b could not be found. Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:04:52.316349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df5b062-9099-42fa-9bcc-40d56163ce2b could not be found. Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df5b062-9099-42fa-9bcc-40d56163ce2b could not be found. Aug 30 00:04:52.317683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:04:52.319741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] Returning 404 to user: Instance 3df5b062-9099-42fa-9bcc-40d56163ce2b could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:04:52.319741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-66214042-b0ac-44d4-8b5e-7019613ce3fc tempest-ServerRescueNegativeTestJSON-2011120560 tempest-ServerRescueNegativeTestJSON-2011120560-project] 10.222.0.60 "GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b" status: 404 len: 111 microversion: 2.1 time: 0.030268 Aug 30 00:04:52.319741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 371/717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:04:52 2022] GET /compute/v2.1/servers/3df5b062-9099-42fa-9bcc-40d56163ce2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:04:52.665717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:52.666266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:52.673362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:52.673837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:52.674269 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:52.674997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:52.675444 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:52.675862 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:52.932737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:52.940714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:52.942144 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:52.943318 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-91dd0193-063c-4589-81dd-dd3e69ab8896 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.282096 Aug 30 00:04:52.943939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 347/718] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:52 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:53.967424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:53.968017 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:53.975325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:53.978562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:53.978562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:53.978562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:53.978562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:53.978992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:54.109274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:54.118375 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:54.119849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:54.121019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d72af56c-6da6-41e8-89ed-c0f7c6b57c60 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.157614 Aug 30 00:04:54.122577 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 372/719] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:53 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:55.145314 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:55.145947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:55.152815 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:55.153537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:55.154589 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:55.155520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:55.155520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:55.155953 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:55.307300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:55.323779 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:55.325423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:55.326819 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1393b86f-ecf9-4e3e-a3f1-21226c6147c6 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.185400 Aug 30 00:04:55.327749 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 348/720] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:55 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:56.349954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:56.351008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:56.357472 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:56.364627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:56.364627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:56.364627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:56.364627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:56.365079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:56.381094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:56.518552 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:56.527266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:56.529518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:56.530089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1b091a6d-636a-419d-84e3-e92261864804 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.184775 Aug 30 00:04:56.530700 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 373/721] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:56 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:57.553771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:57.554380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:57.560799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:57.561275 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:57.561700 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:57.562382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:57.562851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:57.563270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:57.691426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:57.698322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:57.699861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:57.701020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c7b1c792-12bf-465b-9478-6daae20c2f5b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.151617 Aug 30 00:04:57.701582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 349/722] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:57 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:58.724196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:58.725343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:58.732295 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:58.732782 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:58.733284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:58.734038 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:58.734543 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:58.735053 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:58.869698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:58.878030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:58.879657 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:04:58.880858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f7ca6621-05b7-4c90-9b3c-074febc24cf8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.160906 Aug 30 00:04:58.881402 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 374/723] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:58 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:04:59.905296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:04:59.905296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:04:59.911765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:59.912251 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:59.912681 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:04:59.913383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:04:59.913831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:04:59.914250 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:00.049086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:00.058994 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:00.060479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:00.061634 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8618ba17-28a2-47d1-ad36-6a21967aad1d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.161081 Aug 30 00:05:00.062193 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 350/724] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:04:59 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:01.084557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:01.085191 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:01.091149 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.091662 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.092094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.092774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:01.093226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:01.093649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:01.217639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:01.225686 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:01.227227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:01.228367 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-988c917a-ea99-4572-b980-f4f8dfef0c6a tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.148040 Aug 30 00:05:01.228921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 375/725] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:01 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:02.251151 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:02.251747 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:02.258990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:02.259468 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:02.259891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:02.260574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:02.261021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:02.261597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:02.392307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:02.403429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:02.404932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:02.406092 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-34eeaf18-b2a7-4e4a-bc38-7a9492c505fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.158796 Aug 30 00:05:02.418498 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 351/726] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:02 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:03.430055 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:03.430622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:03.437138 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:03.437677 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:03.438042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:03.438756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:03.439211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:03.439641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:03.572201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:03.580405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:03.581853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:03.583035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0a06d920-c383-4d45-b602-f72a75b82675 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.157521 Aug 30 00:05:03.583579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 376/727] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:03 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:05:04.150450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:04.151034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:04.157362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:04.157833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:04.158299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:04.159006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:04.159450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:04.159862 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:04.185193 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bf086e9b-5153-4bf4-a1f7-cb5c515ff4c9 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/ips" status: 200 len: 149 microversion: 2.1 time: 0.038715 Aug 30 00:05:04.185760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 352/728] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:05:04 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:04.605171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:04.606313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:04.612830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:04.613315 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:04.613746 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:04.614435 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:04.615086 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:04.615569 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:04.762109 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:04.770561 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:04.771995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:04.773688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-44ba5c9c-a8ba-40c3-92c6-b94938e62fe2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.172356 Aug 30 00:05:04.774233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 377/729] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:04 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:05.728479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8fc7d39-12de-482e-a39b-e3149122c828"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:05.731100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:05.737849 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:05.738321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:05.738878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:05.739558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:05.739999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:05.740408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:05.797760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:05.797760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:05.803953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:05.804436 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:05.804992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:05.805572 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:05.806033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:05.806417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:05.947162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:05.955987 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:05.957439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:05.961212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d0dbc6f9-01e4-4c48-9ded-1e7412fbff89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1743 microversion: 2.20 time: 0.165510 Aug 30 00:05:05.961212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 378/730] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:05 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:05:06.479062 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c9fdf870-3e82-4a12-9f34-117532f232d7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755126 Aug 30 00:05:06.482141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 353/731] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:05:05 2022] POST /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:06.982073 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:06.982935 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:06.990360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:06.990882 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:06.991332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:06.992057 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:06.992546 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:06.993049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:07.127276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:07.135951 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:07.137913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:07.139324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b14d34e7-b285-46ff-acf8-b17854dd5532 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1743 microversion: 2.20 time: 0.161481 Aug 30 00:05:07.140185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 379/732] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:06 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:08.103967 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-a79feee0-ab74-4629-a05d-62375e7d1377 req-2d39dccd-bf1a-4312-9623-4cbb1ca76c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0f865-8bd9-4058-93d8-be5258b0ffa0", "name": "network-vif-plugged", "status": "completed", "tag": "9971a71c-35a8-48ef-95f0-0729bcc06055"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:08.123411 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-a79feee0-ab74-4629-a05d-62375e7d1377 req-2d39dccd-bf1a-4312-9623-4cbb1ca76c98 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:08.124049 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-a79feee0-ab74-4629-a05d-62375e7d1377 req-2d39dccd-bf1a-4312-9623-4cbb1ca76c98 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:08.124711 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-a79feee0-ab74-4629-a05d-62375e7d1377 req-2d39dccd-bf1a-4312-9623-4cbb1ca76c98 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:08.139596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-a79feee0-ab74-4629-a05d-62375e7d1377 req-2d39dccd-bf1a-4312-9623-4cbb1ca76c98 service nova] Creating event network-vif-plugged:9971a71c-35a8-48ef-95f0-0729bcc06055 for instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 on hv-cinder-85427 Aug 30 00:05:08.146283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-a79feee0-ab74-4629-a05d-62375e7d1377 req-2d39dccd-bf1a-4312-9623-4cbb1ca76c98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048894 Aug 30 00:05:08.147425 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 354/733] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:05:08.168715 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:08.169996 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:08.186421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:08.188515 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:08.188515 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:08.189623 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:08.190104 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:08.190576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:08.360482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:08.369601 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:08.371615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:08.373654 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-397396bd-2617-4f0f-8ed4-86ee1994d51f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.210966 Aug 30 00:05:08.375034 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 380/734] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:08 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:09.406287 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:09.408324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:09.436531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:09.437073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:09.437455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:09.438309 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:09.438796 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:09.440412 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:09.631046 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:09.640958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:09.642799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:09.644260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-917b4ad1-1439-41f8-9b97-d05ac0e1967e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.244158 Aug 30 00:05:09.644843 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 355/735] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:09 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:10.668671 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:10.669288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:10.671726 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:10.676858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:10.677267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:10.677709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:10.678536 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:10.679000 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:10.680273 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:10.836244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:10.845076 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:10.846546 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:10.847710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-838428c8-7512-44fa-8d81-26cd5aeb4040 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.183597 Aug 30 00:05:10.848272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 381/736] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:10 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:11.875494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:11.876765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:11.884536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:11.885472 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:11.886057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:11.886940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:11.887540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:11.888110 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:12.081340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:12.098028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:12.099593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:12.100813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6df9d5b1-1d1b-4037-a790-7d1c8ef53284 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.230074 Aug 30 00:05:12.102713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 356/737] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:11 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:13.135299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:13.136125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:13.143666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:13.144231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:13.145005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:13.145918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:13.146800 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:13.147405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:13.366398 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:13.376068 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:13.377647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:13.378953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-54fdfb19-1136-41ef-8076-a2bff35ffdfb tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.248889 Aug 30 00:05:13.379620 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 382/738] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:13 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:14.207250 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8fc7d39-12de-482e-a39b-e3149122c828"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:14.209893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:14.220878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.221375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.221810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.222557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.223165 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.223924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.315231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Invalid volume: volume e8fc7d39-12de-482e-a39b-e3149122c828 is already attached to instances: 365f024a-9d96-469a-99df-f5bb6ce93c3d Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: POST /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments HTTP/1.1 Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 74 Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:05:14.317100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {"volumeAttachment": {"volumeId": "e8fc7d39-12de-482e-a39b-e3149122c828"}} Aug 30 00:05:14.318931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Invalid volume: volume e8fc7d39-12de-482e-a39b-e3149122c828 is already attached to instances: 365f024a-9d96-469a-99df-f5bb6ce93c3d Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'server_id': '365f024a-9d96-469a-99df-f5bb6ce93c3d', 'body': {'volumeAttachment': {'volumeId': 'e8fc7d39-12de-482e-a39b-e3149122c828'}}} Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e8fc7d39-12de-482e-a39b-e3149122c828 is already attached to instances: 365f024a-9d96-469a-99df-f5bb6ce93c3d Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:05:14.320400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e8fc7d39-12de-482e-a39b-e3149122c828 is already attached to instances: 365f024a-9d96-469a-99df-f5bb6ce93c3d Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:14.321968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:14.323830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:14.323830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:05:14.323830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:05:14.323830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e8fc7d39-12de-482e-a39b-e3149122c828 is already attached to instances: 365f024a-9d96-469a-99df-f5bb6ce93c3d Aug 30 00:05:14.323830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:05:14.323830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 400 to user: Invalid volume: volume e8fc7d39-12de-482e-a39b-e3149122c828 is already attached to instances: 365f024a-9d96-469a-99df-f5bb6ce93c3d {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:05:14.323830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6d4071f6-ca02-4998-90c7-94a2fdaf7b99 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118730 Aug 30 00:05:14.324702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 357/739] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:05:14 2022] POST /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 00:05:14.407808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:14.407808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:14.409499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:14.409995 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:14.413381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.413999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.414529 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.415301 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.415834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.416332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.417088 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.417562 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.417987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.418715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.419164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.419577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.505532 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'services' on Instance uuid 365f024a-9d96-469a-99df-f5bb6ce93c3d {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:14.566297 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:14.575168 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:14.576609 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:14.577761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8d802f4f-dc3a-4393-9cdf-f513f4635a89 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.176108 Aug 30 00:05:14.578318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 383/740] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:14 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:14.887725 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4fa578e0-2570-44a4-a165-aacdde0e7764 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments/e8fc7d39-12de-482e-a39b-e3149122c828" status: 202 len: 0 microversion: 2.1 time: 0.482325 Aug 30 00:05:14.888454 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 358/741] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:05:14 2022] DELETE /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments/e8fc7d39-12de-482e-a39b-e3149122c828 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:14.897131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:14.899640 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:14.906198 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.906814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.907473 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.908177 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:14.908634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:14.909060 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:14.942533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-328ac51d-0440-44f1-ba40-4b15de074e80 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049441 Aug 30 00:05:14.943229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 384/742] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:05:14 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:15.608315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:15.611329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:15.626932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:15.627757 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:15.628425 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:15.629695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:15.630121 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:15.630765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:15.806240 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:15.815823 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:15.817318 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:15.818508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7b7c9893-2811-4b86-85c3-af41cd14d273 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.221749 Aug 30 00:05:15.819117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 359/743] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:15 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:15.955359 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:15.958168 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:15.965944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:15.966556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:15.967071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:15.968021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:15.968546 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:15.969188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:16.009442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ad4fe255-96e1-4c13-8d89-51e996adf16f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052515 Aug 30 00:05:16.015171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 385/744] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:05:15 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:16.841668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:16.842967 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:16.849878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:16.850362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:16.853278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:16.853278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:16.853278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:16.853278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.005865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:17.020912 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:17.022990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:17.030771 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:17.031503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-57f3f0dd-eed2-4dda-8a4c-b7b059db864b tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.190531 Aug 30 00:05:17.032355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:17.039608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:17.040266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:17.040937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.041738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:17.042248 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:17.042761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.044534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 360/745] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:16 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:17.076669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ce6d868c-4a41-4bea-9034-642b3972fc8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058448 Aug 30 00:05:17.077851 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 386/746] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:05:17 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:05:17.147903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:17.148435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:17.154789 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:17.158911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:17.158911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.158911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:17.158911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:17.159253 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.174753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:17.189022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:05:17.515505 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4ddcc8a9-dab2-4fb8-ba45-c5aa7d196e5f tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 204 len: 0 microversion: 2.1 time: 0.371241 Aug 30 00:05:17.516211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 361/747] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:05:17 2022] DELETE /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:05:17.524681 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:17.525305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:17.531750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:17.532168 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:17.532634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.533344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:17.533795 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:17.534220 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:17.686281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:17.696573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9e3685cc-4321-4060-8d62-ca0aecc29619 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1682 microversion: 2.1 time: 0.175786 Aug 30 00:05:17.697202 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 387/748] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:17 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:18.060107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:18.060891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:18.068698 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:18.069205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:18.069641 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:18.070459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:18.070997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:18.071483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:18.200904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:18.209027 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:18.211019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:18.212176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6fbdba00-14ac-48e8-ad00-391c76d8d554 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.158350 Aug 30 00:05:18.212735 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 362/749] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:18 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:18.718258 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:18.718918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:18.725774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:18.726644 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:18.727308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:18.728378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:18.728862 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:18.729272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:18.880806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:18.889355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1ee512d1-305a-47ea-8ebd-c46adfe2f721 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1682 microversion: 2.1 time: 0.175200 Aug 30 00:05:18.890161 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 388/750] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:18 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:19.242523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:19.243371 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:19.250498 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:19.250498 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:19.250764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:19.251458 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:19.251905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:19.252324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:19.487903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:19.497966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:19.499572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:19.500784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-76dad7c8-728c-421e-b1f4-dfb25cfee358 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1738 microversion: 2.20 time: 0.262647 Aug 30 00:05:19.515081 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 363/751] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:19 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:19.914850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:19.914850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:19.920216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:19.920717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:19.921146 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:19.921851 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:19.922304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:19.922824 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:20.014228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:20.026619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9d69fb1a-98fb-451d-aa70-842d6d175164 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1614 microversion: 2.1 time: 0.118695 Aug 30 00:05:20.027847 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 389/752] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:19 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:20.474565 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-804b844b-a5ad-494c-a697-5382e9d3b9bb req-03a5e8ae-71c6-4978-bc9c-0f70cc48c262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365f024a-9d96-469a-99df-f5bb6ce93c3d", "name": "network-vif-deleted", "tag": "84d8699b-b501-4b21-b4a5-60f1cc67f553"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:20.483425 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-804b844b-a5ad-494c-a697-5382e9d3b9bb req-03a5e8ae-71c6-4978-bc9c-0f70cc48c262 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:20.483588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-804b844b-a5ad-494c-a697-5382e9d3b9bb req-03a5e8ae-71c6-4978-bc9c-0f70cc48c262 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:20.483962 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-804b844b-a5ad-494c-a697-5382e9d3b9bb req-03a5e8ae-71c6-4978-bc9c-0f70cc48c262 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:20.498812 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-804b844b-a5ad-494c-a697-5382e9d3b9bb req-03a5e8ae-71c6-4978-bc9c-0f70cc48c262 service nova] Creating event network-vif-deleted:84d8699b-b501-4b21-b4a5-60f1cc67f553 for instance 365f024a-9d96-469a-99df-f5bb6ce93c3d on hv-cinder-85427 Aug 30 00:05:20.502417 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-804b844b-a5ad-494c-a697-5382e9d3b9bb req-03a5e8ae-71c6-4978-bc9c-0f70cc48c262 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280976 Aug 30 00:05:20.503212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 364/753] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:20.524966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:20.525571 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:20.531743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:20.533158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:20.533684 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:20.534866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:20.535329 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:20.535750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:20.553214 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:20.704375 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:20.717240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:20.718710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:20.719997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-03c22834-1194-449a-9672-09f2e57bc99c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1720 microversion: 2.20 time: 0.199845 Aug 30 00:05:20.720540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 390/754] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:20 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:05:21.051505 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:21.052192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:21.058973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:21.059447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:21.059872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:21.060553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:21.060994 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:21.061405 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:21.096977 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:21.097330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:21.097773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:21.098222 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'fault' on Instance uuid 365f024a-9d96-469a-99df-f5bb6ce93c3d {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:21.156519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:21.165218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c1d1f41a-5140-47be-8a02-879a78c22c68 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1332 microversion: 2.1 time: 0.117902 Aug 30 00:05:21.165798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 365/755] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:21 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:21.748200 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:21.752950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:21.758455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:21.758994 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:21.759430 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:21.760136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:21.760610 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:21.761155 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:21.904966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:21.910977 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:21.912400 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:21.914123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5a1e6889-a52a-4497-baa8-4ee22fcb2235 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1720 microversion: 2.20 time: 0.173293 Aug 30 00:05:21.914703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 391/756] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:21 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:22.186396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:22.187975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:22.194580 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:22.195266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:22.195705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:22.196411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:22.196867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:22.197291 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:22.235189 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:22.235685 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:22.236124 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:22.236578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'fault' on Instance uuid 365f024a-9d96-469a-99df-f5bb6ce93c3d {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:22.281654 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:22.291883 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-392eded7-651d-4240-b0c6-ac40fa6f10fc tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 200 len: 1332 microversion: 2.1 time: 0.109414 Aug 30 00:05:22.294338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 392/757] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:22 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:22.327849 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-6ccfaae3-77b7-4604-a571-e6d585fa9b76 req-c8ea59a5-0ba1-4933-ae5c-b3fe668caca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0f865-8bd9-4058-93d8-be5258b0ffa0", "name": "network-vif-unplugged", "status": "completed", "tag": "9971a71c-35a8-48ef-95f0-0729bcc06055"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:22.338766 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-6ccfaae3-77b7-4604-a571-e6d585fa9b76 req-c8ea59a5-0ba1-4933-ae5c-b3fe668caca9 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:22.339246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-6ccfaae3-77b7-4604-a571-e6d585fa9b76 req-c8ea59a5-0ba1-4933-ae5c-b3fe668caca9 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:22.339675 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-6ccfaae3-77b7-4604-a571-e6d585fa9b76 req-c8ea59a5-0ba1-4933-ae5c-b3fe668caca9 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:22.350884 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-6ccfaae3-77b7-4604-a571-e6d585fa9b76 req-c8ea59a5-0ba1-4933-ae5c-b3fe668caca9 service nova] Creating event network-vif-unplugged:9971a71c-35a8-48ef-95f0-0729bcc06055 for instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 on hv-cinder-85427 Aug 30 00:05:22.355764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-6ccfaae3-77b7-4604-a571-e6d585fa9b76 req-c8ea59a5-0ba1-4933-ae5c-b3fe668caca9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.244114 Aug 30 00:05:22.356479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 366/758] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:22.938292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:22.938937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:22.946209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:22.946327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:22.946730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:22.947433 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:22.947884 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:22.948303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:23.087283 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:23.097063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:23.098753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:23.100207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-96a20f7e-8aa1-4a30-990b-07bf920b2e30 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1723 microversion: 2.20 time: 0.166972 Aug 30 00:05:23.100769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 393/759] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:22 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:23.136181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf35824-07ba-4359-9d8e-d7aae1e534ae"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:23.142233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:23.149181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:23.153390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:23.153884 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:23.154318 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:23.155033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:23.155483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:23.155904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:23.313534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:23.314163 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:23.321121 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:23.321590 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:23.322021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:23.322738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:23.323187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:23.323608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:23.338378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d HTTP/1.1 Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:05:23.340144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:05:23.341913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '365f024a-9d96-469a-99df-f5bb6ce93c3d'} Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:05:23.342870 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:05:23.344409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:05:23.345735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:05:23.345735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-237b3281-b4a5-434b-82c3-36d9bbd6c212 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 404 len: 111 microversion: 2.1 time: 0.032206 Aug 30 00:05:23.345735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 394/760] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:23 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:05:23.350250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9e10e93d-e6d8-4800-b48c-0bb10602753c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '.version_select at 0x7f09c2b6be50>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:23.442359 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9e10e93d-e6d8-4800-b48c-0bb10602753c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551860671" status: 202 len: 0 microversion: 2.1 time: 0.095526 Aug 30 00:05:23.442912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 395/761] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 30 00:05:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551860671 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:24.225042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7012ea68-9220-41be-96fb-63735bb40562 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: .version_select at 0x7f09bf32e550>, body: {"keypair": {"name": "tempest-keypair-772678333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIlKv0FvLNC9NZ7xwjq+2itF7nuOG6UE+r7oMICkJOvGvLAVNnXoJILz7KvxvWUxJJbOUZSPdGd20VV+AVrth5QGM+n4QENfo5v48lmTFI3ggRSJKccU0iO8j5PGb7eMQ=="}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:24.243485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-7012ea68-9220-41be-96fb-63735bb40562 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:05:24.246731 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-7012ea68-9220-41be-96fb-63735bb40562 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:05:24.361353 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-82ec561b-5fe8-43a2-860f-c5b820172aa8 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.235608 Aug 30 00:05:24.362412 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 367/762] 10.222.0.60 () {62 vars in 1364 bytes} [Tue Aug 30 00:05:23 2022] POST /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-volume_attachments => generated 188 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:05:24.362768 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7012ea68-9220-41be-96fb-63735bb40562 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141984 Aug 30 00:05:24.363374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 396/763] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:05:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:05:24.497589 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:24.498003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:24.503991 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:24.504471 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:24.504900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:24.505588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:24.506035 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:24.506554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:24.847879 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:24.848364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:24.857404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:24.858587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:24.859108 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:24.859947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:24.860501 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:24.860981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:24.885153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2f531634-19d5-488b-bc23-b437c2bac45b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/ips" status: 200 len: 146 microversion: 2.1 time: 0.214841 Aug 30 00:05:24.885726 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 397/764] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:05:24 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/ips => generated 146 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:05:25.209668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-517249bf-2c48-492f-aff2-58b6bbcc5ef9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-volume_attachments/acf35824-07ba-4359-9d8e-d7aae1e534ae" status: 202 len: 0 microversion: 2.20 time: 0.712760 Aug 30 00:05:25.209668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 368/765] 10.222.0.60 () {60 vars in 1457 bytes} [Tue Aug 30 00:05:24 2022] DELETE /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-volume_attachments/acf35824-07ba-4359-9d8e-d7aae1e534ae => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:05:25.542018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:25.542780 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:25.552415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:25.560460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:25.560460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:25.560460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:25.560460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:25.562013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:25.591408 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127769) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 00:05:25.935526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-65978848-03d9-4370-846f-977f1df3a8ca tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "POST /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/action" status: 202 len: 0 microversion: 2.20 time: 0.397485 Aug 30 00:05:25.936169 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 398/766] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 30 00:05:25 2022] POST /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 00:05:25.944255 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:25.945461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:25.952217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:25.952705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:25.953140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:25.953835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:25.954480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:25.955086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:26.120611 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:26.130459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:26.132036 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:26.134221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d5e57204-314e-4729-89de-989bdc31edd3 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1671 microversion: 2.20 time: 0.193926 Aug 30 00:05:26.135031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 369/767] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:25 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1671 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:26.648120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60f7fe2-b7f1-4f80-8832-f5bb60a1b769"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:26.650597 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:26.657360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:26.658038 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:26.658570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:26.659292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:26.660128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:26.660714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:26.888479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-302796428", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb60052-2932-481b-a354-8ea27a27493d"}], "security_groups": [{"name": "tempest-securitygroup--1785834067"}], "key_name": "tempest-keypair-772678333", "user_data": "}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:27.024762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] validate_networks() for [('ffb60052-2932-481b-a354-8ea27a27493d', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:05:27.514892 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:05:27.515311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:05:27.518696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:05:27.518696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:05:27.518696 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:05:27.529113 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:27.529591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:27.530035 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:27.530885 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:27.531340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:27.540525 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:27.547437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b86dc1e8-0f99-4ce2-b385-76b27038878b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903448 Aug 30 00:05:27.549530 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 399/768] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:05:26 2022] POST /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:27.562572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:05:27.568652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Getting quotas for user f144bc14d1464de6befc9061ca159dbc and project 6c19a4c87f3f4a3390cec0c13eadc084. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:05:27.575728 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:27.576753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:27.582428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:05:27.583213 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:27.583701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:27.584132 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:27.585041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:27.585290 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:27.586281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:27.587222 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:05:27.729180 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-40b950b5-44ef-4ab8-bdd5-e0edbf6cddec tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.850812 Aug 30 00:05:27.734512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 370/769] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:05:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 00:05:27.735711 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:27.741227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bfca3761-1cae-4623-a235-86bb53f57432 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:27.742516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bfca3761-1cae-4623-a235-86bb53f57432 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:27.749309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:27.750778 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:27.751943 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c44a41b4-c027-41b2-8d84-6a546e6a3d01 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1673 microversion: 2.20 time: 0.201171 Aug 30 00:05:27.776045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 400/770] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:27 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:27.820051 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bfca3761-1cae-4623-a235-86bb53f57432 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:27.830350 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bfca3761-1cae-4623-a235-86bb53f57432 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1240 microversion: 2.1 time: 0.093017 Aug 30 00:05:27.830954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 371/771] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:27 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:28.780296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:28.780692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:28.787276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:28.787758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:28.788196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:28.789452 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:28.789908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:28.790336 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:28.852019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:28.852732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:28.859146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:28.859617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:28.860241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:28.860925 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:28.861366 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:28.861777 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:28.918112 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:28.924132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:28.926492 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:28.927960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:28.929115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-77d58976-3df8-4c99-995f-8d1b98235fe0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.153101 Aug 30 00:05:28.929867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 401/772] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:28 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:28.931673 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a59774ac-83ef-4e62-b3a4-79cc993eb4e5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1244 microversion: 2.1 time: 0.084179 Aug 30 00:05:28.932217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 372/773] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:28 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:29.951965 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:29.952629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:29.953011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:29.953112 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:29.958907 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:29.959048 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:29.959385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:29.959505 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:29.959813 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:29.959916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:29.960497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:29.960598 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:29.960946 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:29.961047 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:29.961370 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:29.961537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:30.024411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:30.032197 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c2db1694-87de-4d76-87d5-f6a48b36ed3e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1244 microversion: 2.1 time: 0.084136 Aug 30 00:05:30.032772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 402/774] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:29 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:30.091099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:30.094516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:30.099443 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:30.101414 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:30.102719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a8ff34da-1d4b-4142-979e-5d68be8f0997 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.154568 Aug 30 00:05:30.103513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 373/775] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:29 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:31.052288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:31.052909 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:31.059850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:31.060322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:31.060760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:31.061511 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:31.061968 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:31.062401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:31.129665 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:31.135613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:31.136832 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:31.138342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e7bc12a9-b7a7-4be4-b5a0-ef643b90fcd1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1244 microversion: 2.1 time: 0.089912 Aug 30 00:05:31.145055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:31.147470 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:31.149173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:31.150948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 403/776] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:31 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:31.152560 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:31.156137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:31.156137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:31.292335 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:31.300706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:31.302160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:31.303342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6242c5f5-af62-4d28-8186-7f35ff36ae29 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.172650 Aug 30 00:05:31.303903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 374/777] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:31 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:32.160019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:32.160555 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:32.168450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:32.169219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:32.169950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:32.170718 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:32.171176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:32.171773 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:32.245470 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:32.258074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d7f3e68b-9ab7-4f19-a58d-d28cb759b802 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1300 microversion: 2.1 time: 0.101726 Aug 30 00:05:32.259023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 404/778] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:32 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:32.326602 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:32.327912 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:32.334192 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:32.334701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:32.341573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:32.341573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:32.341573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:32.341573 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:32.505732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:32.514778 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:32.516176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:32.517346 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9ec83604-a9e4-462f-b768-ea7a17e4fde9 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.194716 Aug 30 00:05:32.518137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 375/779] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:32 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:33.282370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:33.283126 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:33.290997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:33.291480 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:33.291923 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:33.292650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:33.293114 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:33.293539 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:33.359194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:33.368381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-503042b3-a90e-4c13-9cd0-7b87216efadb tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1300 microversion: 2.1 time: 0.091135 Aug 30 00:05:33.369211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 405/780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:33 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:33.543920 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:33.543920 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:33.549214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:33.549957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:33.550738 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:33.551827 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:33.552491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:33.553028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:33.702065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:33.715200 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:33.716807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:33.717989 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3561136a-6c29-47cc-97d8-5a76ee76e071 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.180568 Aug 30 00:05:33.718887 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 376/781] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:33 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:34.391236 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:34.620991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:34.620991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=4 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:34.620991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:34.620991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:34.622707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:34.622707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:34.622707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:34.622707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:34.623008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:34.623008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0ffe12db-d721-482d-a3da-60f3c3c1903e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1300 microversion: 2.1 time: 0.095328 Aug 30 00:05:34.623008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 406/782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:34 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:34.744068 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:34.744748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:34.753173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:34.753809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:34.754260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:34.755202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:34.755651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:34.756067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:34.928198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:34.937451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:34.938679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:34.940138 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d1e6455c-1348-4816-9f47-7360dbda585c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.201276 Aug 30 00:05:34.940972 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 377/783] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:34 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:35.610837 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:35.612175 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:35.622591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.623050 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.623473 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.624165 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.624607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.625020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.629304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:35.637057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:35.637339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:35.644195 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.649682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.649682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.649682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.649682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.650072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.749549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:35.770069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7add348c-b039-4551-9a0a-940cb64860cf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1300 microversion: 2.1 time: 0.128883 Aug 30 00:05:35.784816 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 378/784] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:35 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:35.821225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lazy-loading 'flavor' on Instance uuid d0a7c39c-c5e6-4553-be70-454ad70a50da {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:35.965327 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:35.966085 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:35.972773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.972773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.973172 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.973866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.974321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.974770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:36.122357 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:36.147214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:36.147214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:36.153984 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-118d6cd0-169d-4f35-bc5c-902816fcb3a2 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.192721 Aug 30 00:05:36.154922 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 379/785] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:35 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:05:36.229745 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a4a967a5-a042-4d96-838a-e0dfadc67a99 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "POST /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da/action" status: 202 len: 0 microversion: 2.1 time: 0.623240 Aug 30 00:05:36.230679 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 407/786] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:05:35 2022] POST /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:36.238945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:36.239958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:36.246168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:36.247387 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:36.247387 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:36.247782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:36.248228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:36.248653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:36.411870 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:36.420442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-84648f36-4b4f-413c-8605-075c37c6fdd2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.185288 Aug 30 00:05:36.426695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 380/787] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:36 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:36.794004 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:36.794862 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:36.801490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:36.802193 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:36.802907 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:36.803757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:36.804909 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:36.805436 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:36.896521 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:36.919113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-eab1170b-e8d5-44c5-8fac-60e75675fe73 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1300 microversion: 2.1 time: 0.130399 Aug 30 00:05:36.923254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 408/788] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:36 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:37.187019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:37.187628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:37.194356 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.195717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.196515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:37.197226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.197721 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.198147 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:37.417891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:37.428137 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:37.430669 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:37.431850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ec26d736-c1a7-4d22-87c1-0d7e67501a3e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.249977 Aug 30 00:05:37.432419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 381/789] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:37 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:37.455038 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:37.459171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:37.474265 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.478914 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.479367 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:37.481394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.497759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.498575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:37.701613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:37.711628 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ed12cf0e-e349-4520-aae0-d90153e74e66 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.265199 Aug 30 00:05:37.712482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 409/790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:37 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:37.947157 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:37.947695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:37.951651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:37.953542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=8 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:37.957140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.957729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.958257 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:37.959081 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.959652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.960278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.047571 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:38.058401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c4a7692a-6ebe-4c39-9cdd-d57061b54888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1300 microversion: 2.1 time: 0.116651 Aug 30 00:05:38.067234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 382/791] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:37 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:38.465605 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:38.466527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:38.472993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.474284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.474284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.474834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.475421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.476002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.627921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:38.637649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:38.639227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:38.640393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3baaab90-6e9e-4276-83b2-e7cfc03e44b0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.187809 Aug 30 00:05:38.640941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 410/792] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:38 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:38.734785 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:38.735510 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:38.742719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.743199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.743631 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.744443 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.744897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.745907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.886354 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:38.896002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-81d5f4b1-b6fa-42c5-b06d-20d2d4242d93 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.165574 Aug 30 00:05:38.896581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 383/793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:38 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:39.079630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:39.080265 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:39.087394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.088005 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.088424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.089133 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.090122 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.090842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.187791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:39.200285 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dc3492f3-cc3e-463e-94c4-c5dc2a498d4b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1300 microversion: 2.1 time: 0.124381 Aug 30 00:05:39.201423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 411/794] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:39 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:39.663954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:39.664558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:39.670462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.670971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.671400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.672092 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.672543 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.672963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.815871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:39.824414 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:39.825869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:39.827052 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-14bc9065-219f-4957-8c7e-db6f5bf0497d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.167758 Aug 30 00:05:39.827618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 384/795] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:39 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:39.919842 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:39.921166 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:39.930494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.931689 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.931689 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.932330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.932855 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.933287 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.073022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:40.091146 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2298f23f-e967-4471-8c57-117d55670c86 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.166369 Aug 30 00:05:40.091146 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 412/796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:39 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:40.222309 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:40.222955 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:40.229664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.230154 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.230619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.231339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.231780 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.232195 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.308223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:40.316158 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cbbd3640-cd05-4bc9-9f59-b507080e1cf4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1298 microversion: 2.1 time: 0.097803 Aug 30 00:05:40.316737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 385/797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:40 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:40.849836 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:40.850396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:40.856468 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.856948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.857376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.858215 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.858645 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.859065 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:41.006798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:41.022292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:41.023893 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:41.032483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c4f36428-cc39-4e1f-bfb8-ef5233a477fe tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.179282 Aug 30 00:05:41.032483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 413/798] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:40 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:41.107071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:41.107576 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:41.114668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:41.115503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:41.116003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:41.117295 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:41.117739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:41.118386 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:41.279312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:41.305737 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ad2e43aa-55db-411c-9d54-af8c47031a20 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.199846 Aug 30 00:05:41.322973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 386/799] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:41 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:41.343555 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:41.344840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:41.353316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:41.354228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:41.354876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:41.355850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:41.356518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:41.357100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:41.513767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:41.524585 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-abbcf6a7-d68c-4428-8f03-cfd3df278381 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.190374 Aug 30 00:05:41.525143 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 414/800] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:41 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:42.031662 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-07638ab5-53cc-40f5-8f22-319bc455f0cb req-8e75c4f2-858a-4289-8ade-ed134d9c1c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3230020-6076-4bbf-b047-3a5e752583ca", "tag": "b4dfc18f-64a1-4d35-8e65-f1e89edffae9"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:42.041943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-07638ab5-53cc-40f5-8f22-319bc455f0cb req-8e75c4f2-858a-4289-8ade-ed134d9c1c44 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.042534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-07638ab5-53cc-40f5-8f22-319bc455f0cb req-8e75c4f2-858a-4289-8ade-ed134d9c1c44 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.043170 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-07638ab5-53cc-40f5-8f22-319bc455f0cb req-8e75c4f2-858a-4289-8ade-ed134d9c1c44 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.048695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.049464 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.055414 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-07638ab5-53cc-40f5-8f22-319bc455f0cb req-8e75c4f2-858a-4289-8ade-ed134d9c1c44 service nova] Creating event network-changed:b4dfc18f-64a1-4d35-8e65-f1e89edffae9 for instance b3230020-6076-4bbf-b047-3a5e752583ca on hv-cinder-85427 Aug 30 00:05:42.057023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.057767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.058309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.059153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.059668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.060255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.061943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-07638ab5-53cc-40f5-8f22-319bc455f0cb req-8e75c4f2-858a-4289-8ade-ed134d9c1c44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034675 Aug 30 00:05:42.062581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 387/801] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:05:42.329026 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.330943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.345421 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.346429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.349761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.353966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.354617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.355431 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.534018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:42.546596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:42.549259 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:42.551548 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-60876f93-a0ed-4c38-bbf4-e55a7fd03190 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.506646 Aug 30 00:05:42.553755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 415/802] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:05:42.558404 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.559137 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.567537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.573142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.573142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.573142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.573142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.573694 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.714670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:42.723212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-05103aac-864a-44d3-be1e-63eda98ac1ea tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.398829 Aug 30 00:05:42.724780 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 388/803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:42.740052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:42.758887 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5cc79f84-cdf8-4d2e-b0a6-811f787bb618 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.205657 Aug 30 00:05:42.759516 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 416/804] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:42.788477 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.791126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.798411 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.799328 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.799970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.800951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.801606 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.802380 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.835388 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-61a72bf2-8b4d-450d-a4ef-60c9aeff3f70 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050799 Aug 30 00:05:42.841915 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 389/805] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:42.848941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.853629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.860589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.861343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.862017 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.862755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.863414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.864624 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.901151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-13b26576-b1d9-4c6c-883a-627cea5cdd65 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/f60f7fe2-b7f1-4f80-8832-f5bb60a1b769" status: 200 len: 194 microversion: 2.1 time: 0.057537 Aug 30 00:05:42.902112 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 417/806] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/f60f7fe2-b7f1-4f80-8832-f5bb60a1b769 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:05:43.574584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:43.575128 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:43.581153 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.581627 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.582057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.582766 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.583242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.583661 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.717104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:43.725187 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:43.727233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:43.728384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-77f60b68-eb81-4faa-8428-48628532b6be tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.157815 Aug 30 00:05:43.728947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 390/807] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:43 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:43.747997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:43.748627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:43.751115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:43.756318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.759195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.759195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.759195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.759195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.759578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.783002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:43.787938 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:43.795209 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.795822 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.796482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.797537 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.798165 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.798886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.805556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:43.899301 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:43.908068 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d323fcec-950d-41b0-bbe5-d85fec37dd84 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.163998 Aug 30 00:05:43.909196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 418/808] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:43 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:43.946082 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:43.953868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b7d0c283-9893-410a-9ae2-1a73539862bd tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.175137 Aug 30 00:05:43.954429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 391/809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:43 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:44.432387 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-bba47341-93fe-4234-8749-bd9ab85e32bb req-0fb9660d-d89f-4feb-85e3-c6fd31dc9889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0f865-8bd9-4058-93d8-be5258b0ffa0", "name": "network-vif-plugged", "status": "completed", "tag": "9971a71c-35a8-48ef-95f0-0729bcc06055"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:44.440472 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-bba47341-93fe-4234-8749-bd9ab85e32bb req-0fb9660d-d89f-4feb-85e3-c6fd31dc9889 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.441004 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-bba47341-93fe-4234-8749-bd9ab85e32bb req-0fb9660d-d89f-4feb-85e3-c6fd31dc9889 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.441541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-bba47341-93fe-4234-8749-bd9ab85e32bb req-0fb9660d-d89f-4feb-85e3-c6fd31dc9889 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.453477 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-bba47341-93fe-4234-8749-bd9ab85e32bb req-0fb9660d-d89f-4feb-85e3-c6fd31dc9889 service nova] Creating event network-vif-plugged:9971a71c-35a8-48ef-95f0-0729bcc06055 for instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 on hv-cinder-85427 Aug 30 00:05:44.458270 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-bba47341-93fe-4234-8749-bd9ab85e32bb req-0fb9660d-d89f-4feb-85e3-c6fd31dc9889 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032364 Aug 30 00:05:44.461865 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 419/810] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:44.584385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cac59aa-924a-4ec9-853d-6fab876dbded"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:44.586831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:44.593132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.593613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.594042 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.594750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.595199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.595613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.750962 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:44.751940 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:44.760875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.761473 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.761977 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.762835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.763436 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.763926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.902114 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:44.911746 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:44.913775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:44.915001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f2647969-4923-48c1-9918-fc3b7bbab234 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.168498 Aug 30 00:05:44.915860 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 420/811] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:44 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:05:44.936439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:44.937147 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:44.943723 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.944785 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.945212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.945916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.947151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.947581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:45.087043 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:45.094897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-cddf934c-3049-4323-b14e-7ebb9be4b1f5 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.167109 Aug 30 00:05:45.095455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 421/812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:44 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:45.099876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:45.100473 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:45.106107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:45.106616 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:45.107045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:45.107863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:45.108338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:45.108746 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:45.126374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:45.239556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:45.248033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-fe9b0cd0-eca1-4518-9d5b-db50c6700bbf tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.151580 Aug 30 00:05:45.248592 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 422/813] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:45 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:45.473254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-876b97a9-762f-47be-a985-61a6c09f03bc tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "POST /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892863 Aug 30 00:05:45.473869 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 392/814] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:05:44 2022] POST /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:45.940711 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:45.941227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:45.948379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:45.948863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:45.949300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:45.949990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:45.950444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:45.950891 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:46.078015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:46.086732 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:46.088184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:46.089346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7f92fc61-2300-47a9-aded-ededb5780809 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.152681 Aug 30 00:05:46.089904 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 423/815] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:45 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:46.116708 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:46.117443 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:46.123654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:46.124132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:46.124564 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:46.125350 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:46.125736 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:46.126547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:46.255479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:46.263402 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-aa260714-6039-4993-8a95-ff205cf79892 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.151464 Aug 30 00:05:46.264160 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 393/816] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:46 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:46.269153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:46.269834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:46.276333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:46.276876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:46.277370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:46.278054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:46.278526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:46.279041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:46.409203 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:46.416793 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6bad947c-ab4b-452c-9638-bf227643fcb1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.151469 Aug 30 00:05:46.417345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 424/817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:46 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:47.112896 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:47.113458 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:47.120453 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:47.121011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:47.121322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:47.122001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:47.122448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:47.122895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:47.248592 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:47.256548 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:47.258334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:47.259549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-115659cb-4e5e-4281-ba81-6c5bfc463e3c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.150760 Aug 30 00:05:47.260127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 394/818] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:47 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:47.284657 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:47.285264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:47.292159 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:47.292640 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:47.293074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:47.293763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:47.294216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:47.294699 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:47.422732 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:47.431063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-02212643-7854-4695-a906-ddb636ddd2c2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.150262 Aug 30 00:05:47.431618 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 425/819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:47 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:47.436940 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:47.437551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:47.443375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:47.443856 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:47.444307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:47.444995 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:47.445444 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:47.445864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:47.572463 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:47.580248 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fd4339ba-5408-4265-9530-dbcc64ee4888 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.147094 Aug 30 00:05:47.580809 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 395/820] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:47 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:48.203427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-44ef4b21-26b5-43d9-82f1-4478624f1900 req-53b631b1-d290-499b-ac6a-b0f2623552ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3230020-6076-4bbf-b047-3a5e752583ca", "name": "network-vif-plugged", "status": "completed", "tag": "b4dfc18f-64a1-4d35-8e65-f1e89edffae9"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:48.215157 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-44ef4b21-26b5-43d9-82f1-4478624f1900 req-53b631b1-d290-499b-ac6a-b0f2623552ae service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.215641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-44ef4b21-26b5-43d9-82f1-4478624f1900 req-53b631b1-d290-499b-ac6a-b0f2623552ae service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.216066 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-44ef4b21-26b5-43d9-82f1-4478624f1900 req-53b631b1-d290-499b-ac6a-b0f2623552ae service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.227334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-44ef4b21-26b5-43d9-82f1-4478624f1900 req-53b631b1-d290-499b-ac6a-b0f2623552ae service nova] Creating event network-vif-plugged:b4dfc18f-64a1-4d35-8e65-f1e89edffae9 for instance b3230020-6076-4bbf-b047-3a5e752583ca on hv-cinder-85427 Aug 30 00:05:48.233956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-44ef4b21-26b5-43d9-82f1-4478624f1900 req-53b631b1-d290-499b-ac6a-b0f2623552ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032462 Aug 30 00:05:48.233956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 426/821] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:48.282937 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:48.284687 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:48.292310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.293016 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.293446 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.294141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.294810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.295398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.431878 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:48.440150 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:48.442052 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:48.443258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f39bd802-5858-48cd-8a49-bb0baf4ec72e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.165119 Aug 30 00:05:48.443841 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 396/822] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:48 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:48.453911 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:48.454873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:48.463331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.464150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.465065 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.466257 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.467090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.467925 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.601711 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:48.602383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:48.608379 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.608865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.609270 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:48.609463 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.609998 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.610428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.610874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.618816 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0a0758c1-f006-41d5-9a8e-7e8b9c4ada82 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.170512 Aug 30 00:05:48.619382 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 427/823] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:48 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:48.739609 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:48.747435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c06b2647-341d-41eb-a2dd-cbb41d44b8a1 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.150095 Aug 30 00:05:48.748086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 397/824] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:48 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:49.468494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:49.469549 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:49.478444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.479169 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.479612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.480363 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.480788 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.481219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.618132 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:49.626149 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:49.627633 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:49.628782 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c59740f0-dc2e-4363-969d-4d8374499cfa tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1729 microversion: 2.20 time: 0.165051 Aug 30 00:05:49.629338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 428/825] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:49 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:49.639613 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:49.643598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:49.646757 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.647242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.648244 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.648938 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.649395 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.649815 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.787625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:49.788346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:49.797216 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:49.798845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.799578 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.800018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.800947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.801410 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.802349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.810253 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7f3671c3-1f0e-415f-9d99-65e382bc93c1 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.174258 Aug 30 00:05:49.811440 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 398/826] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:49 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:49.939534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:49.947864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6c61a941-4e21-4491-97e9-b075f93de218 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1366 microversion: 2.1 time: 0.182725 Aug 30 00:05:49.948445 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 429/827] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:49 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:50.653381 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:50.653987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:50.660404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.661098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.661526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.662216 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.662861 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.663871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.832051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:50.833300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:50.840844 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.841335 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.841771 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.842499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.842956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.843384 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.878748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:50.888417 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:50.890074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:50.894117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-491c5593-6444-4ced-aad8-5b14e1979cb0 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1716 microversion: 2.20 time: 0.242366 Aug 30 00:05:50.894117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 399/828] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:05:50 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1716 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:05:50.969169 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:50.969793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:50.976947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.977495 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.977938 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.978960 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.979484 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.979913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.988737 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:50.997966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-343a84af-def5-4112-9616-8f4159f13310 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.169302 Aug 30 00:05:50.998558 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 430/829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:50 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:51.177905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:51.185639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d5298c5b-d886-4711-9a58-38f7b007426e tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1555 microversion: 2.1 time: 0.220984 Aug 30 00:05:51.186290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 400/830] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:50 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:51.208777 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:51.209277 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:51.216161 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:51.216649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:51.217077 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:51.217797 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:51.218246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:51.218711 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:51.294720 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e96fabf3-d452-4544-92a6-aac781dc0fe4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089845 Aug 30 00:05:51.295353 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 431/831] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 30 00:05:51 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:52.072103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:52.072103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:52.072103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:52.072103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:52.073323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:52.073323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:52.073323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:52.073323 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:52.185264 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:52.193106 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-619c2ea3-3882-4e42-ac84-eb0323ac48ff tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.170720 Aug 30 00:05:52.193740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 401/832] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:52 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:52.437580 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-0e5cbf53-a658-4ea6-8cfa-ea1b04273658 req-fca720a3-cf08-4676-8212-ef28dfd05cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3230020-6076-4bbf-b047-3a5e752583ca", "tag": "b4dfc18f-64a1-4d35-8e65-f1e89edffae9"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:52.453539 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-0e5cbf53-a658-4ea6-8cfa-ea1b04273658 req-fca720a3-cf08-4676-8212-ef28dfd05cf6 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:52.454032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-0e5cbf53-a658-4ea6-8cfa-ea1b04273658 req-fca720a3-cf08-4676-8212-ef28dfd05cf6 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:52.454492 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-0e5cbf53-a658-4ea6-8cfa-ea1b04273658 req-fca720a3-cf08-4676-8212-ef28dfd05cf6 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:52.472040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-0e5cbf53-a658-4ea6-8cfa-ea1b04273658 req-fca720a3-cf08-4676-8212-ef28dfd05cf6 service nova] Creating event network-changed:b4dfc18f-64a1-4d35-8e65-f1e89edffae9 for instance b3230020-6076-4bbf-b047-3a5e752583ca on hv-cinder-85427 Aug 30 00:05:52.479867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-0e5cbf53-a658-4ea6-8cfa-ea1b04273658 req-fca720a3-cf08-4676-8212-ef28dfd05cf6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177735 Aug 30 00:05:52.480479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 432/833] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:53.218278 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:53.219770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:53.229197 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:53.229909 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:53.230404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:53.231458 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:53.231911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:53.232399 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:53.422003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:53.432043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4363bbd7-7aa9-43f1-b903-0f4113a877dd tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.218185 Aug 30 00:05:53.438578 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 402/834] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:53 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:54.456717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:54.457397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:54.464393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.464874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.465304 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:54.465995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.466908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.466908 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:54.620687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:54.628678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e4bc67c7-55e8-43d8-95eb-957434e7e9a2 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1511 microversion: 2.1 time: 0.177073 Aug 30 00:05:54.629233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 433/835] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:54 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:54.654749 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:54.655481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:54.657947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:54.666798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.666798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.666798 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:54.667233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.667683 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.668111 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:54.714829 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127768) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 00:05:54.957514 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3cad0221-9328-4a27-9888-f4ce517c612b tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "POST /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da/action" status: 202 len: 0 microversion: 2.1 time: 0.306811 Aug 30 00:05:54.958132 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 403/836] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:05:54 2022] POST /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:54.966946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:54.967604 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:54.989148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.989656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.990098 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:54.990843 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.991328 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.991757 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:55.179466 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:55.189397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-83869f01-73ac-419c-b804-52b688b61af4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1519 microversion: 2.1 time: 0.226351 Aug 30 00:05:55.194521 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 434/837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:54 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:56.138040 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-f8ea6110-d68a-4e23-8106-39db67df65c9 req-d0f2a12e-2117-4101-8728-2dcd3682a689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a7c39c-c5e6-4553-be70-454ad70a50da", "name": "network-vif-unplugged", "status": "completed", "tag": "a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:56.193483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f8ea6110-d68a-4e23-8106-39db67df65c9 req-d0f2a12e-2117-4101-8728-2dcd3682a689 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.193483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f8ea6110-d68a-4e23-8106-39db67df65c9 req-d0f2a12e-2117-4101-8728-2dcd3682a689 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.193483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-f8ea6110-d68a-4e23-8106-39db67df65c9 req-d0f2a12e-2117-4101-8728-2dcd3682a689 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.193483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.compute.server_external_events [req-f8ea6110-d68a-4e23-8106-39db67df65c9 req-d0f2a12e-2117-4101-8728-2dcd3682a689 service nova] Unable to find a host for instance d0a7c39c-c5e6-4553-be70-454ad70a50da. Dropping event network-vif-unplugged {{(pid=127768) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 00:05:56.194900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-f8ea6110-d68a-4e23-8106-39db67df65c9 req-d0f2a12e-2117-4101-8728-2dcd3682a689 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060967 Aug 30 00:05:56.195538 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 404/838] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 00:05:56.211605 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:56.212215 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:56.223152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.223152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.223152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.223152 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.223646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.223646 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.260223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:56.265988 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:56.273687 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.273687 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.274857 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.276115 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.276575 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.277002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.312098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3be068c6-9aa0-44e7-a8fb-66ddcb82eedd tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057616 Aug 30 00:05:56.312824 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 405/839] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:05:56 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:05:56.434995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:56.443001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-db9fc1fb-fbff-4cc5-9429-9d87fe7eedeb tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1521 microversion: 2.1 time: 0.236091 Aug 30 00:05:56.443806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 435/840] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:56 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:56.471518 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:56.471997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:56.478462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.478967 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.479394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.480073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.480518 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.480932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.484562 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:56.510984 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-25390774-e2e7-4236-8680-41e6e7f856e7 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/f60f7fe2-b7f1-4f80-8832-f5bb60a1b769" status: 200 len: 194 microversion: 2.1 time: 0.043440 Aug 30 00:05:56.511593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 406/841] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Aug 30 00:05:56 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/f60f7fe2-b7f1-4f80-8832-f5bb60a1b769 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:56.521826 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:56.522323 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:56.528239 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.528727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.529163 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.529860 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:56.530316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:56.530766 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.618369 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lazy-loading 'services' on Instance uuid dd1e8890-dd0e-46f4-88c0-448632b42a35 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:56.859553 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-cdb213a7-2efe-45e0-956f-e31f80f78eb2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/f60f7fe2-b7f1-4f80-8832-f5bb60a1b769" status: 202 len: 0 microversion: 2.1 time: 0.341412 Aug 30 00:05:56.861843 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 436/842] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:05:56 2022] DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/f60f7fe2-b7f1-4f80-8832-f5bb60a1b769 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:57.469286 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:57.470644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:57.479932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:57.480729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:57.481872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:57.483434 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:57.484056 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:57.484487 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:57.636519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:57.644639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dff74df0-ce3f-46df-846d-268accaee62f tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1521 microversion: 2.1 time: 0.181848 Aug 30 00:05:57.645204 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 407/843] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:57 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:58.670737 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:58.671380 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:58.678001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:58.682078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:58.682078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:58.682078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:58.682078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:58.682433 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:58.894587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:58.904460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-385945af-4eec-47dc-9abb-ee760e33b1d4 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.239037 Aug 30 00:05:58.905279 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 437/844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:58 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:59.060607 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:59.061300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:59.069759 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.073024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.073024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:59.073024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.073024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.073410 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:59.104534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0f5352a4-58bd-4648-b49a-22b0e391e4e2 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/9cac59aa-924a-4ec9-853d-6fab876dbded" status: 200 len: 194 microversion: 2.1 time: 0.047923 Aug 30 00:05:59.105144 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 408/845] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Aug 30 00:05:59 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/9cac59aa-924a-4ec9-853d-6fab876dbded => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:59.117023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:59.119190 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:59.124371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.124861 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.125298 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:59.125994 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.126447 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.126901 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:59.209472 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lazy-loading 'services' on Instance uuid dd1e8890-dd0e-46f4-88c0-448632b42a35 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:59.423445 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-859590d7-e7a1-4764-9606-f5ee2da6aa9d tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/9cac59aa-924a-4ec9-853d-6fab876dbded" status: 202 len: 0 microversion: 2.1 time: 0.311659 Aug 30 00:05:59.424897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 438/846] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:05:59 2022] DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments/9cac59aa-924a-4ec9-853d-6fab876dbded => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:59.932547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:59.933275 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:59.939441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.940001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.940524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:59.941223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.941725 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.942857 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.083024 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:00.091500 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7645d869-52b3-475c-af4f-485c4cdb7e19 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.165148 Aug 30 00:06:00.092109 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 409/847] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:59 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:00.605585 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:00.607944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:00.614162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.614692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.615133 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.616327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.616786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.617210 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.634629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:00.646937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-47e062db-5d73-4efa-9f13-22cbf068a71b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046259 Aug 30 00:06:00.647490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 439/848] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:06:00 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:06:00.770407 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:00.772572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:00.778826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.779306 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.779741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.780435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.780883 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.781392 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.810847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1d3f30bb-69d9-4565-85a8-cade85d4ed60 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044250 Aug 30 00:06:00.811405 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 410/849] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:06:00 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:06:00.872070 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:00.872576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:00.879482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.879970 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.880406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.881100 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.889669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.889669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.907672 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:06:01.113068 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:01.113774 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:01.120821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:01.121299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:01.121729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:01.122419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:01.122891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:01.123310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:01.184755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0822a577-fa08-4e08-b090-7e0cfdb7fae3 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 204 len: 0 microversion: 2.1 time: 0.316095 Aug 30 00:06:01.185680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 440/850] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:00 2022] DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:06:01.200370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:01.201144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:01.207164 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:01.207637 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:01.208067 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:01.208763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:01.209194 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:01.209643 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:01.252915 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:01.261123 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-aadc2ab8-028d-4f97-8433-e4bf1aa5d34a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.151965 Aug 30 00:06:01.261758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 411/851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:01 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:01.343088 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:01.351561 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d85323b6-d4bd-4117-8b33-90b281a04767 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1673 microversion: 2.1 time: 0.155564 Aug 30 00:06:01.352125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 441/852] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:01 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:02.281483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:02.282122 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:02.288745 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:02.289854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:02.290293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:02.291017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:02.291467 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:02.291890 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:02.373426 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:02.374120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:02.380879 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:02.381484 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:02.381966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:02.383041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:02.383507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:02.383937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:02.429602 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:02.437547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8a829b5d-15e8-43b6-aae4-2ec868bad61d tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.159957 Aug 30 00:06:02.438127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 412/853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:02 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:02.516896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:02.525250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4cd2e1b0-2784-414a-87aa-3e9e96c37128 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1673 microversion: 2.1 time: 0.155986 Aug 30 00:06:02.525806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 442/854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:02 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:03.460085 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:03.461304 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:03.467660 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:03.468145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:03.468577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:03.472419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:03.472419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:03.472419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:03.546226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:03.547991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:03.555341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:03.555837 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:03.556278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:03.556978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:03.557750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:03.558395 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:03.703300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:03.712742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-85d1c5a2-4ff2-4677-ac84-184af6d645cf tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.257094 Aug 30 00:06:03.713331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 413/855] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:03 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:03.714046 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:03.723736 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9444661a-4f34-4a71-b642-2c46bab7e7e5 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1673 microversion: 2.1 time: 0.180476 Aug 30 00:06:03.725253 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 443/856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:03 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:04.175876 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-da338774-98a4-480c-9340-5dce348ccbfc req-3fe3e3c6-0a0a-45d4-9ff7-f3480adf687f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e8890-dd0e-46f4-88c0-448632b42a35", "name": "network-vif-deleted", "tag": "949b050f-eda4-4836-844b-e0fb6a44df8a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:04.187983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-da338774-98a4-480c-9340-5dce348ccbfc req-3fe3e3c6-0a0a-45d4-9ff7-f3480adf687f service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.188451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-da338774-98a4-480c-9340-5dce348ccbfc req-3fe3e3c6-0a0a-45d4-9ff7-f3480adf687f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.188870 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-da338774-98a4-480c-9340-5dce348ccbfc req-3fe3e3c6-0a0a-45d4-9ff7-f3480adf687f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.205257 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-da338774-98a4-480c-9340-5dce348ccbfc req-3fe3e3c6-0a0a-45d4-9ff7-f3480adf687f service nova] Creating event network-vif-deleted:949b050f-eda4-4836-844b-e0fb6a44df8a for instance dd1e8890-dd0e-46f4-88c0-448632b42a35 on hv-cinder-85427 Aug 30 00:06:04.211374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-da338774-98a4-480c-9340-5dce348ccbfc req-3fe3e3c6-0a0a-45d4-9ff7-f3480adf687f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039247 Aug 30 00:06:04.214739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 414/857] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:04.735978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:04.736613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:04.749218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:04.749911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:04.752834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.753585 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.754028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.755948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.755948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.755948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.763859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.764353 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.764784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.765482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.765933 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.766352 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.800267 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.813061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.813527 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.814175 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lazy-loading 'fault' on Instance uuid dd1e8890-dd0e-46f4-88c0-448632b42a35 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:06:04.858131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f27121b3ab54d5194dedcbe4b112727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2a9053ef0c4083a5c8afbfcb7bb3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:04.865907 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-789ca21d-bcc2-44c4-9c02-a903606df420 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 200 len: 1327 microversion: 2.1 time: 0.121350 Aug 30 00:06:04.866578 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 415/858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:04 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:04.912713 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:04.922181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-660150f5-4596-45cb-826b-c220e41f11de tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.190282 Aug 30 00:06:04.923266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 444/859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:04 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:05.887175 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:05.887779 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:05.894874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:05.895362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:05.895844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:05.896545 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:05.896990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:05.897406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:05.912252 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] HTTP exception thrown: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Request method failure captured: Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 HTTP/1.1 Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLzymYp0clIGGbeaSuCTTtb8tPNS2ArypM_izntymF2j0kQ2seHdfZCncpB1nbZ8_yWLe-HQLg85VN_cPaqjN49lKJR1jC8Vxld9pZtG2V0YyNKSR_xVsha2kfJkmjM6Ff_2KnJZXqDdW1BEIhUX8aD6l1hq1JzGsB2mqds_pKqi2s Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:05.914932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}] Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 3f27121b3ab54d5194dedcbe4b112727 Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:05.916803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'dd1e8890-dd0e-46f4-88c0-448632b42a35'} Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:05.917734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:05.919404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:05.920963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Returning 404 to user: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:05.920963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-82833db6-f2f6-4d40-9aea-99e4ec88143a tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 404 len: 111 microversion: 2.1 time: 0.033577 Aug 30 00:06:05.920963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 416/860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:05 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:05.925614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-655d3343-27db-462b-8e4c-0b9cf685e9ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '.version_select at 0x7f09bf34bb80>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:05.943067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:05.943659 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:05.949493 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:05.954448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:05.954448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:05.954448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:05.954448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:05.954801 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:06.019761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-655d3343-27db-462b-8e4c-0b9cf685e9ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817054252" status: 202 len: 0 microversion: 2.1 time: 0.097839 Aug 30 00:06:06.020593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 445/861] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 30 00:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817054252 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:06:06.096750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:06.106335 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-46a89be8-d75f-4ec0-8d05-372316f634a9 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.166945 Aug 30 00:06:06.120837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 417/862] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:05 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:07.127521 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:07.128227 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:07.136975 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:07.137458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:07.137921 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:07.138687 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:07.139138 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:07.139562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:07.270956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:07.279533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-72b93087-5cae-4d5d-9fe5-5e5ad44b795e tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.156399 Aug 30 00:06:07.281348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 446/863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:07 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:08.264140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-b58f2928-2fa9-446e-828f-dae9d4071a84 req-5fdae9cd-f1f4-4648-930d-16fe63c90692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a7c39c-c5e6-4553-be70-454ad70a50da", "name": "network-vif-plugged", "status": "completed", "tag": "a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:08.274028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-b58f2928-2fa9-446e-828f-dae9d4071a84 req-5fdae9cd-f1f4-4648-930d-16fe63c90692 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:08.274534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-b58f2928-2fa9-446e-828f-dae9d4071a84 req-5fdae9cd-f1f4-4648-930d-16fe63c90692 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:08.274969 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-b58f2928-2fa9-446e-828f-dae9d4071a84 req-5fdae9cd-f1f4-4648-930d-16fe63c90692 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:08.285717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-b58f2928-2fa9-446e-828f-dae9d4071a84 req-5fdae9cd-f1f4-4648-930d-16fe63c90692 service nova] Creating event network-vif-plugged:a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802 for instance d0a7c39c-c5e6-4553-be70-454ad70a50da on hv-cinder-85427 Aug 30 00:06:08.290707 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-b58f2928-2fa9-446e-828f-dae9d4071a84 req-5fdae9cd-f1f4-4648-930d-16fe63c90692 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030273 Aug 30 00:06:08.291319 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 418/864] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:08.301504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:08.304522 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:08.309118 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:08.309605 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:08.310042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:08.310869 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:08.311326 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:08.311751 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:08.455127 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:08.462840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-561ef068-d98c-4ac3-a4e1-0a3db89ab997 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.165628 Aug 30 00:06:08.463407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 447/865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:08 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:09.484492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:09.485310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:09.491385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.491885 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.492315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.492998 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.493446 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.493863 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.627858 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:09.639646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b5ee4be0-a1b5-4dbe-9484-5a36bc0027d0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1577 microversion: 2.1 time: 0.158344 Aug 30 00:06:09.639646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 419/866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:09 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:09.667944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:09.668424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:09.675072 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.675560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.676003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.676700 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.677191 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.678015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.691525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] HTTP exception thrown: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Request method failure captured: Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 HTTP/1.1 Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLzymYp0clIGGbeaSuCTTtb8tPNS2ArypM_izntymF2j0kQ2seHdfZCncpB1nbZ8_yWLe-HQLg85VN_cPaqjN49lKJR1jC8Vxld9pZtG2V0YyNKSR_xVsha2kfJkmjM6Ff_2KnJZXqDdW1BEIhUX8aD6l1hq1JzGsB2mqds_pKqi2s Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:09.693241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}] Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 3f27121b3ab54d5194dedcbe4b112727 Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.694789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'dd1e8890-dd0e-46f4-88c0-448632b42a35'} Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:09.695574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.697401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.700389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Returning 404 to user: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:09.700389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b40813bb-52cd-4060-b15e-301102b17f0b tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 404 len: 111 microversion: 2.1 time: 0.030551 Aug 30 00:06:09.700389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 448/867] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:09 2022] DELETE /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:09.703797 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:09.704408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: dd1e8890-dd0e-46f4-88c0-448632b42a35] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:09.710898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.711420 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.712913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.713638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.714105 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.714643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.728651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] HTTP exception thrown: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Request method failure captured: Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 HTTP/1.1 Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLzymYp0clIGGbeaSuCTTtb8tPNS2ArypM_izntymF2j0kQ2seHdfZCncpB1nbZ8_yWLe-HQLg85VN_cPaqjN49lKJR1jC8Vxld9pZtG2V0YyNKSR_xVsha2kfJkmjM6Ff_2KnJZXqDdW1BEIhUX8aD6l1hq1JzGsB2mqds_pKqi2s Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:09.730553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}] Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 3f27121b3ab54d5194dedcbe4b112727 Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.732142 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'dd1e8890-dd0e-46f4-88c0-448632b42a35'} Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:09.733336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. Aug 30 00:06:09.735271 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:09.737695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Returning 404 to user: Instance dd1e8890-dd0e-46f4-88c0-448632b42a35 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:09.738646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-51da5ed9-d224-431e-870f-4145405124ca tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35" status: 404 len: 111 microversion: 2.1 time: 0.038534 Aug 30 00:06:09.739200 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 420/868] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:09 2022] GET /compute/v2.1/servers/dd1e8890-dd0e-46f4-88c0-448632b42a35 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:10.659635 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:10.660245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:10.667199 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:10.667605 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:10.667809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:10.668504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:10.669070 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:10.669376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:10.803634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:10.812053 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c2d548fe-6911-4c69-ae76-7f082ec18b23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1564 microversion: 2.1 time: 0.156420 Aug 30 00:06:10.812615 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 449/869] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:10 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:11.013575 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:11.014085 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:11.020931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:11.021646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:11.022270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:11.023231 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:11.024463 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:11.025049 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:11.039353 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] HTTP exception thrown: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Request method failure captured: Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 HTTP/1.1 Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLzymYp0clIGGbeaSuCTTtb8tPNS2ArypM_izntymF2j0kQ2seHdfZCncpB1nbZ8_yWLe-HQLg85VN_cPaqjN49lKJR1jC8Vxld9pZtG2V0YyNKSR_xVsha2kfJkmjM6Ff_2KnJZXqDdW1BEIhUX8aD6l1hq1JzGsB2mqds_pKqi2s Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:11.041225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}] Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 3f27121b3ab54d5194dedcbe4b112727 Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.042939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '68880fbb-7000-4185-b41d-5b4241962ca9'} Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:11.043893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.046114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.047408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Returning 404 to user: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:11.047408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ad8a1c1e-105e-4c5f-8d4a-1875f6b583fb tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 404 len: 111 microversion: 2.1 time: 0.037573 Aug 30 00:06:11.047408 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 421/870] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:11 2022] DELETE /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:06:11.052536 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:11.053173 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] [instance: 68880fbb-7000-4185-b41d-5b4241962ca9] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:11.060004 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:11.060489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:11.060934 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:11.061632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:11.062094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:11.062564 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:11.076281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] HTTP exception thrown: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Request method failure captured: Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 HTTP/1.1 Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLzymYp0clIGGbeaSuCTTtb8tPNS2ArypM_izntymF2j0kQ2seHdfZCncpB1nbZ8_yWLe-HQLg85VN_cPaqjN49lKJR1jC8Vxld9pZtG2V0YyNKSR_xVsha2kfJkmjM6Ff_2KnJZXqDdW1BEIhUX8aD6l1hq1JzGsB2mqds_pKqi2s Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:11.077853 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9b2a9053ef0c4083a5c8afbfcb7bb3c9"}]}] Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 9b2a9053ef0c4083a5c8afbfcb7bb3c9 Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824976184 Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 3f27121b3ab54d5194dedcbe4b112727 Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeTestJSON-824976184-project Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.080758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '68880fbb-7000-4185-b41d-5b4241962ca9'} Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:11.081833 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. Aug 30 00:06:11.083784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:11.085597 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] Returning 404 to user: Instance 68880fbb-7000-4185-b41d-5b4241962ca9 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:11.085597 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ce8eb446-98ba-4294-bbae-633975eb6852 tempest-AttachVolumeTestJSON-824976184 tempest-AttachVolumeTestJSON-824976184-project] 10.222.0.60 "GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9" status: 404 len: 111 microversion: 2.1 time: 0.030670 Aug 30 00:06:11.085597 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 450/871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:11 2022] GET /compute/v2.1/servers/68880fbb-7000-4185-b41d-5b4241962ca9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:28.519179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:28.520007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=76 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:28.687428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:28.687981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:28.694050 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:28.694562 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:28.695000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:28.695685 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:28.696767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:28.697190 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:28.720399 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-56e3e8b4-be7d-4c5b-82a1-4fdbf22bc060 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/ips" status: 200 len: 148 microversion: 2.1 time: 0.206488 Aug 30 00:06:28.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 422/872] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:06:28 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/ips => generated 148 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:29.611704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:29.613976 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:29.621345 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:29.622025 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:29.623626 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:29.624113 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:29.624550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:29.625255 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:29.625709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:29.626136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:29.655107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4c7cd91a-3635-431a-8e03-b080bd35c783 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047318 Aug 30 00:06:29.655661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 451/873] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 30 00:06:29 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:29.717260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:29.718306 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:29.725103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:29.725787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:29.726217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:29.726928 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:29.727875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:29.728316 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:29.754011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:06:30.057198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c31a0787-6d5b-4fea-8aef-b33beb007e71 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 204 len: 0 microversion: 2.20 time: 0.343471 Aug 30 00:06:30.057799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 423/874] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 30 00:06:29 2022] DELETE /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 00:06:30.070243 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:30.072462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:30.082294 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:30.082844 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:30.083288 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:30.085262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:30.085262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:30.085262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:30.220424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:30.228550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:30.230042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:30.231251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2db10d97-8214-4cc8-a19d-0fbcbe6c8c5d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.165371 Aug 30 00:06:30.231799 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 452/875] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:30 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:06:30.465182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39a98d69-23ea-4165-afe3-4a8abc44fea2"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:30.467651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:30.473480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:30.473954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:30.474378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:30.475077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:30.475518 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:30.475929 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:31.254783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:31.255385 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:31.262316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:31.262832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:31.263261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:31.263938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:31.264385 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:31.264802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:31.390733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:31.398956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:31.400902 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:31.402078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-cd009d31-5a93-4b2b-9c8f-58e7e6f2e4c4 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.151347 Aug 30 00:06:31.402713 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 453/876] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:31 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:06:32.425580 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:32.426196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:32.432998 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:32.433462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:32.433885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:32.434589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:32.435131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:32.435600 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:32.565375 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:32.573731 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:32.575451 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:32.576601 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-09b2133b-3d7f-4053-8eac-567205540856 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.155020 Aug 30 00:06:32.577154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 454/877] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:32 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:06:33.593743 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d3fbbf41-0068-4780-8506-8f7216b3ba41 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "POST /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.133336 Aug 30 00:06:33.599716 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 424/878] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:06:30 2022] POST /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments => generated 194 bytes in 3135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:33.600762 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:33.601621 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:33.609269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:33.611164 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:33.611164 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:33.611564 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:33.612187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:33.612688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:33.756068 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:33.766262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:33.767883 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:33.769068 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6d874fcb-8159-4efe-8352-8d088f846208 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1722 microversion: 2.20 time: 0.173040 Aug 30 00:06:33.770515 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 455/879] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:33 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:06:34.442073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-aa1c46e6-315b-455d-88c3-d8a259ee1fba req-f1c6a01b-afde-4cb1-885e-1b5fc917e152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0f865-8bd9-4058-93d8-be5258b0ffa0", "name": "network-vif-deleted", "tag": "9971a71c-35a8-48ef-95f0-0729bcc06055"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:34.454114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-aa1c46e6-315b-455d-88c3-d8a259ee1fba req-f1c6a01b-afde-4cb1-885e-1b5fc917e152 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.454622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-aa1c46e6-315b-455d-88c3-d8a259ee1fba req-f1c6a01b-afde-4cb1-885e-1b5fc917e152 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.455054 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-aa1c46e6-315b-455d-88c3-d8a259ee1fba req-f1c6a01b-afde-4cb1-885e-1b5fc917e152 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.466631 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-aa1c46e6-315b-455d-88c3-d8a259ee1fba req-f1c6a01b-afde-4cb1-885e-1b5fc917e152 service nova] Creating event network-vif-deleted:9971a71c-35a8-48ef-95f0-0729bcc06055 for instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 on hv-cinder-85427 Aug 30 00:06:34.471449 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-aa1c46e6-315b-455d-88c3-d8a259ee1fba req-f1c6a01b-afde-4cb1-885e-1b5fc917e152 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Aug 30 00:06:34.472378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 425/880] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:34.794358 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:34.801792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:34.809912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.810394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.818183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.818974 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.819441 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.821502 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.856551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:34.857032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:34.857457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:34.857897 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lazy-loading 'fault' on Instance uuid 22b0f865-8bd9-4058-93d8-be5258b0ffa0 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:06:34.901521 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:34.911332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:34.912949 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7812e8e2bc794f1cbd19c1c176bb93af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7a55e59082408b8cb5822d7bd33478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:34.919063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f8d8c552-c244-4ea1-bf1a-c59c9204b14c tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 200 len: 1371 microversion: 2.20 time: 0.123770 Aug 30 00:06:34.919063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 456/881] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:34 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:06:35.937874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:35.938591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:35.944583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:35.945055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:35.945493 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:35.946154 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:35.946632 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:35.947046 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:35.959695 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] HTTP exception thrown: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Request method failure captured: Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 HTTP/1.1 Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLtgufVo4C5xeCOe9RkNDJEQSqA_5sGsmH3FiLB8wi-0hP94XC051Deog0u7pDmW_M5FuFhm1seWi2FSE8H_p3qvAXnjJdUd8WcckvwNLRXMlPfBUOphQiVxAAXjvsZWIOtGumY-7wI3pXFtNYkSDMq5xnXY9fEVgZibZcRgCsiD5E Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:35.961266 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}] Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 7812e8e2bc794f1cbd19c1c176bb93af Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:35.963482 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '22b0f865-8bd9-4058-93d8-be5258b0ffa0'} Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:35.964597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:35.966034 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:35.967398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Returning 404 to user: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:35.967398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a7cc4881-33fd-498d-8487-db03e56f5f76 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 404 len: 111 microversion: 2.20 time: 0.029932 Aug 30 00:06:35.967398 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 426/882] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:35 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:06:35.972630 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0206e273-1dbf-404d-be9e-69a5e1304d7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '.version_select at 0x7f09c07ba1f0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:36.076660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0206e273-1dbf-404d-be9e-69a5e1304d7d tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110301350" status: 204 len: 0 microversion: 2.20 time: 0.107821 Aug 30 00:06:36.077274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 457/883] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Aug 30 00:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110301350 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 00:06:38.132114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:38.132851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:38.139176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.139655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.143033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.143033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.143033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.143033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.155567 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] HTTP exception thrown: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Request method failure captured: Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 HTTP/1.1 Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLtgufVo4C5xeCOe9RkNDJEQSqA_5sGsmH3FiLB8wi-0hP94XC051Deog0u7pDmW_M5FuFhm1seWi2FSE8H_p3qvAXnjJdUd8WcckvwNLRXMlPfBUOphQiVxAAXjvsZWIOtGumY-7wI3pXFtNYkSDMq5xnXY9fEVgZibZcRgCsiD5E Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:38.159697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}] Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 7812e8e2bc794f1cbd19c1c176bb93af Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.161098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '22b0f865-8bd9-4058-93d8-be5258b0ffa0'} Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:38.162074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.163375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.164639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Returning 404 to user: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:38.164639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ba72b44a-6c4a-4c93-861b-ce24ea44ac6f tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 404 len: 111 microversion: 2.20 time: 0.030231 Aug 30 00:06:38.164639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 427/884] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 30 00:06:38 2022] DELETE /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 00:06:38.171008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:38.171623 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: 22b0f865-8bd9-4058-93d8-be5258b0ffa0] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:38.178076 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.178643 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.179091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.179784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:38.180239 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:38.180667 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:38.195927 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] HTTP exception thrown: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Request method failure captured: Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 HTTP/1.1 Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLtgufVo4C5xeCOe9RkNDJEQSqA_5sGsmH3FiLB8wi-0hP94XC051Deog0u7pDmW_M5FuFhm1seWi2FSE8H_p3qvAXnjJdUd8WcckvwNLRXMlPfBUOphQiVxAAXjvsZWIOtGumY-7wI3pXFtNYkSDMq5xnXY9fEVgZibZcRgCsiD5E Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:38.197417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}] Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 7812e8e2bc794f1cbd19c1c176bb93af Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.199573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '22b0f865-8bd9-4058-93d8-be5258b0ffa0'} Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:38.200299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. Aug 30 00:06:38.201581 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:38.202774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Returning 404 to user: Instance 22b0f865-8bd9-4058-93d8-be5258b0ffa0 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:38.202774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-56d224cb-46fd-4882-9113-11350f01829e tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0" status: 404 len: 111 microversion: 2.20 time: 0.032225 Aug 30 00:06:38.202774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 458/885] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:38 2022] GET /compute/v2.1/servers/22b0f865-8bd9-4058-93d8-be5258b0ffa0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:06:39.466071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:39.466667 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:39.473088 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:39.473664 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:39.473996 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:39.474715 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:39.475170 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:39.475595 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:39.490897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] HTTP exception thrown: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Request method failure captured: Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 HTTP/1.1 Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVLtgufVo4C5xeCOe9RkNDJEQSqA_5sGsmH3FiLB8wi-0hP94XC051Deog0u7pDmW_M5FuFhm1seWi2FSE8H_p3qvAXnjJdUd8WcckvwNLRXMlPfBUOphQiVxAAXjvsZWIOtGumY-7wI3pXFtNYkSDMq5xnXY9fEVgZibZcRgCsiD5E Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:39.492439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}] Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 7812e8e2bc794f1cbd19c1c176bb93af Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.494642 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'bfa3cd3e-c701-4851-a613-4c89ea690072'} Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:39.495501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.496957 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.498702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Returning 404 to user: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:39.498702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d7e35ed2-07b7-4cc4-9958-52480f57a287 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 404 len: 111 microversion: 2.20 time: 0.032362 Aug 30 00:06:39.498702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 428/886] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 30 00:06:39 2022] DELETE /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:06:39.503052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:39.503666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] [instance: bfa3cd3e-c701-4851-a613-4c89ea690072] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:39.510065 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:39.510572 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:39.511007 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:39.511706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:39.512156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:39.512587 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:39.526913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] HTTP exception thrown: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Request method failure captured: Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 HTTP/1.1 Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVLtgufVo4C5xeCOe9RkNDJEQSqA_5sGsmH3FiLB8wi-0hP94XC051Deog0u7pDmW_M5FuFhm1seWi2FSE8H_p3qvAXnjJdUd8WcckvwNLRXMlPfBUOphQiVxAAXjvsZWIOtGumY-7wI3pXFtNYkSDMq5xnXY9fEVgZibZcRgCsiD5E Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:39.528695 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1f7a55e59082408b8cb5822d7bd33478"}]}] Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 1f7a55e59082408b8cb5822d7bd33478 Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-127070872 Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 7812e8e2bc794f1cbd19c1c176bb93af Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-127070872-project Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.530318 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'bfa3cd3e-c701-4851-a613-4c89ea690072'} Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:39.531875 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. Aug 30 00:06:39.533374 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:39.534639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] Returning 404 to user: Instance bfa3cd3e-c701-4851-a613-4c89ea690072 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:39.534639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e9b6dfae-817e-4adf-a00b-767ff2e98e17 tempest-AttachVolumeShelveTestJSON-127070872 tempest-AttachVolumeShelveTestJSON-127070872-project] 10.222.0.60 "GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072" status: 404 len: 111 microversion: 2.20 time: 0.030931 Aug 30 00:06:39.534639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 459/887] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 30 00:06:39 2022] GET /compute/v2.1/servers/bfa3cd3e-c701-4851-a613-4c89ea690072 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:06:41.303829 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:41.304451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:41.310617 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:41.311073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:41.311712 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:41.312401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:41.312891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:41.313260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:41.410051 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'services' on Instance uuid b3230020-6076-4bbf-b047-3a5e752583ca {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:06:41.737790 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d4c0c6e3-93bf-4c73-a4db-a91fc4d6bc79 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments/39a98d69-23ea-4165-afe3-4a8abc44fea2" status: 202 len: 0 microversion: 2.1 time: 0.437689 Aug 30 00:06:41.738815 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 429/888] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:06:41 2022] DELETE /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments/39a98d69-23ea-4165-afe3-4a8abc44fea2 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:06:41.748201 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:41.751162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:41.765999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:41.766697 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:41.767440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:41.769207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:41.773217 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:41.773217 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:41.808895 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4067e83b-98b4-4787-ae50-105c6271ae8d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064777 Aug 30 00:06:41.809809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 460/889] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:06:41 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:42.827350 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:42.831499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:42.840405 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:42.842969 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:42.845270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:42.848265 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:42.849331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:42.850113 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:42.970051 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6889b77c-e2f1-4197-9fa0-804b40289b6c tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152396 Aug 30 00:06:42.970661 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 430/890] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:06:42 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:06:43.064169 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:43.065476 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:43.073210 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:43.074526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:43.075139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:43.076032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:43.076645 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:43.077225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:43.108517 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:06:43.458264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-166f1049-c09a-4819-b250-9ba154e0f5f8 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 204 len: 0 microversion: 2.1 time: 0.397677 Aug 30 00:06:43.459040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 461/891] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:43 2022] DELETE /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:06:43.468025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:43.468615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:43.474516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:43.475004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:43.475436 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:43.476123 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:43.476570 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:43.477579 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:43.708341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:43.726856 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f71f9167-ea64-4be6-ad17-a377f4dae9ba tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1679 microversion: 2.1 time: 0.262559 Aug 30 00:06:43.740202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 431/892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:43 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:44.749054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:44.749989 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:44.758704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:44.759871 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:44.760427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:44.780736 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:44.781300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:44.781807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:44.938058 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:44.947570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-eb46f0ae-f30f-4772-afaa-d97323d4059a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1679 microversion: 2.1 time: 0.203819 Aug 30 00:06:44.948151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 462/893] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:44 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:45.622074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-24dae5aa-a7fd-4158-8b87-f04c665e86b4 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Action: 'create', calling method: .version_select at 0x7f09bf155700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1766062962"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:45.969226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:45.970267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:45.979613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:45.980104 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:45.980543 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:45.981246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:45.981724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:45.982123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:46.052095 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:46.059943 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-156f4bd4-fd54-4022-ba3d-bd32b7954fff tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1611 microversion: 2.1 time: 0.094604 Aug 30 00:06:46.060494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 463/894] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:45 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1611 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:46.192594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-88a3cae2-1410-4f02-b71c-2bce9af2210d req-9024ad8b-e359-4563-8179-26fac90595f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3230020-6076-4bbf-b047-3a5e752583ca", "name": "network-vif-deleted", "tag": "b4dfc18f-64a1-4d35-8e65-f1e89edffae9"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:46.206593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-88a3cae2-1410-4f02-b71c-2bce9af2210d req-9024ad8b-e359-4563-8179-26fac90595f7 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:46.207316 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-88a3cae2-1410-4f02-b71c-2bce9af2210d req-9024ad8b-e359-4563-8179-26fac90595f7 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:46.209520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-88a3cae2-1410-4f02-b71c-2bce9af2210d req-9024ad8b-e359-4563-8179-26fac90595f7 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:46.219501 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-88a3cae2-1410-4f02-b71c-2bce9af2210d req-9024ad8b-e359-4563-8179-26fac90595f7 service nova] Creating event network-vif-deleted:b4dfc18f-64a1-4d35-8e65-f1e89edffae9 for instance b3230020-6076-4bbf-b047-3a5e752583ca on hv-cinder-85427 Aug 30 00:06:46.224342 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-88a3cae2-1410-4f02-b71c-2bce9af2210d req-9024ad8b-e359-4563-8179-26fac90595f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Aug 30 00:06:46.225141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 464/895] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:46.360260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-24dae5aa-a7fd-4158-8b87-f04c665e86b4 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.877684 Aug 30 00:06:46.361011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 432/896] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Aug 30 00:06:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 879 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 00:06:46.374549 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-076147e4-3c55-439a-84d2-571f2938229d tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf32e700>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:46.440986 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-076147e4-3c55-439a-84d2-571f2938229d tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 200 len: 345 microversion: 2.1 time: 0.070850 Aug 30 00:06:46.441771 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 465/897] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:46 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:06:47.081840 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:47.082781 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:47.090301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:47.090818 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:47.091252 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:47.091948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:47.092400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:47.092821 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:47.126972 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:47.127457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:47.127888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:47.128338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lazy-loading 'fault' on Instance uuid b3230020-6076-4bbf-b047-3a5e752583ca {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:06:47.170125 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f144bc14d1464de6befc9061ca159dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c19a4c87f3f4a3390cec0c13eadc084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:47.178900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9bafcb1d-eb45-4ba4-8a13-cf52439ece02 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 200 len: 1330 microversion: 2.1 time: 0.101454 Aug 30 00:06:47.179386 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 433/898] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:47 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:47.455443 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-38eb56a2-18f0-4fe7-a815-c58657638a6e tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09c2b10280>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:47.501907 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-38eb56a2-18f0-4fe7-a815-c58657638a6e tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 200 len: 346 microversion: 2.1 time: 0.050786 Aug 30 00:06:47.502520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 466/899] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:47 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:06:47.515275 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6f062889-360d-456b-8122-56d3b73b4f62 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Action: 'create', calling method: .version_select at 0x7f09bf155430>, body: {"snapshot": {"volume_id": "8c733c94-3395-4340-8a88-ac0c18c9479e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-686965274"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:47.925077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6f062889-360d-456b-8122-56d3b73b4f62 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.413607 Aug 30 00:06:47.925708 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 434/900] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Aug 30 00:06:47 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:06:47.936659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b4e630ad-e0f5-457d-8788-c16db29b3ec9 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf42e310>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:47.968543 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b4e630ad-e0f5-457d-8788-c16db29b3ec9 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 200 len: 286 microversion: 2.1 time: 0.036085 Aug 30 00:06:47.976128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 467/901] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:47 2022] GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:47.980029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-751b19b5-7d57-41b3-b846-436748e5a7ff tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf18f700>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:48.012351 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-751b19b5-7d57-41b3-b846-436748e5a7ff tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036110 Aug 30 00:06:48.013053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 435/902] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Aug 30 00:06:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:48.024022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-bcca76c8-f6a1-46fa-aa14-ed07401b9b76 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf42edc0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:48.054254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-bcca76c8-f6a1-46fa-aa14-ed07401b9b76 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 200 len: 286 microversion: 2.1 time: 0.034101 Aug 30 00:06:48.054859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 468/903] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:48 2022] GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:48.204087 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:48.205007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:48.211757 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:48.212227 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:48.212652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:48.213330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:48.213777 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:48.214194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:48.227017 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca HTTP/1.1 Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:48.228647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:48.230333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'b3230020-6076-4bbf-b047-3a5e752583ca'} Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:48.231355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:48.232943 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:48.234374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:48.234374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1c718976-5827-4614-b83d-286f46302389 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 404 len: 111 microversion: 2.1 time: 0.030268 Aug 30 00:06:48.234374 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 436/904] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:48 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:48.238930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-04e28384-c3d0-43f9-8078-539728eacce5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '.version_select at 0x7f09bf38ce50>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:48.335061 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-04e28384-c3d0-43f9-8078-539728eacce5 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772678333" status: 202 len: 0 microversion: 2.1 time: 0.099769 Aug 30 00:06:48.335794 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 469/905] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Aug 30 00:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772678333 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:06:49.067726 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1fe30a06-9db8-46e5-8815-6e41298e6d1f tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf1bde50>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:49.117540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1fe30a06-9db8-46e5-8815-6e41298e6d1f tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 200 len: 286 microversion: 2.1 time: 0.052009 Aug 30 00:06:49.117540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 437/906] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:49 2022] GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:06:50.129093 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-af3b64df-e139-4108-a52b-a6c8fbebcafd tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf34b5e0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:50.160709 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-af3b64df-e139-4108-a52b-a6c8fbebcafd tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 200 len: 286 microversion: 2.1 time: 0.036039 Aug 30 00:06:50.161281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 470/907] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:50 2022] GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:51.174437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b38fa5fb-aa31-40c4-bf83-b1e32b0c2e59 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf2740d0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:51.206580 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b38fa5fb-aa31-40c4-bf83-b1e32b0c2e59 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 200 len: 287 microversion: 2.1 time: 0.036649 Aug 30 00:06:51.208558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 438/908] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:51 2022] GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:51.218632 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5a5723e6-667c-4897-b33a-7130f23c0a6a tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf343d30>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:51.361812 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5a5723e6-667c-4897-b33a-7130f23c0a6a tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 202 len: 0 microversion: 2.1 time: 0.147409 Aug 30 00:06:51.362416 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 471/909] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Aug 30 00:06:51 2022] DELETE /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:06:51.371365 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-973c5f5f-e572-4aa8-9e85-f320a358e24c tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf155f70>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:51.405721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:51.405721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:51.416334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:51.416334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:51.416334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:51.416334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:51.416639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:51.416639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:51.416788 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-973c5f5f-e572-4aa8-9e85-f320a358e24c tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 200 len: 286 microversion: 2.1 time: 0.048930 Aug 30 00:06:51.417159 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 439/910] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:51 2022] GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:06:51.428625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: DELETE /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca HTTP/1.1 Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:51.430596 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.432461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'b3230020-6076-4bbf-b047-3a5e752583ca'} Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:51.433284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.434822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.436221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:51.436221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3f0b43fe-efbf-4827-91ee-8339ce5b8a62 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 404 len: 111 microversion: 2.1 time: 0.031756 Aug 30 00:06:51.436221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 472/911] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:51 2022] DELETE /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:06:51.441636 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:51.443593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: b3230020-6076-4bbf-b047-3a5e752583ca] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:51.448896 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:51.449385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:51.449827 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:51.450571 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:51.451031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:51.451455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:51.466934 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca HTTP/1.1 Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:51.472321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.474071 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'b3230020-6076-4bbf-b047-3a5e752583ca'} Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:51.475031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. Aug 30 00:06:51.477375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:51.479608 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance b3230020-6076-4bbf-b047-3a5e752583ca could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:51.479608 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b5b505b3-7e02-4f86-80e2-076a07888c51 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca" status: 404 len: 111 microversion: 2.1 time: 0.032063 Aug 30 00:06:51.479608 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 440/912] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:51 2022] GET /compute/v2.1/servers/b3230020-6076-4bbf-b047-3a5e752583ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:52.430554 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c2138d20-9e24-4f98-bfa3-cdbbd21010a7 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf32ed30>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:52.456303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-c2138d20-9e24-4f98-bfa3-cdbbd21010a7 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] HTTP exception thrown: Snapshot dbc10109-8c58-4ce0-9453-44c5f30c9614 could not be found. Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c2138d20-9e24-4f98-bfa3-cdbbd21010a7 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Request method failure captured: Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 HTTP/1.1 Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVSVygisYLTs62vPo-SGjAPBlvmqy4Uy0X27JmTjCwDQJ_sOpdja5Q-z7IiOGR_WWPpyuAAVWDCHOwXkHkA2jJ6_rGhdudVAqgnqGRWDP3kSYhRgnBG1m_ZdjZmoVESqaN4ligbjxcgYXwgEoAsovWKK3AhqYNLu0uV0SygDKssisvU Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:52.459457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faf59cc423140208cdbb295c8298807"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faf59cc423140208cdbb295c8298807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}] Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 480ae3d446b14beea47a1c9aefbcab67 Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Snapshot dbc10109-8c58-4ce0-9453-44c5f30c9614 could not be found. Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'dbc10109-8c58-4ce0-9453-44c5f30c9614'} Aug 30 00:06:52.461158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dbc10109-8c58-4ce0-9453-44c5f30c9614 could not be found. (HTTP 404) (Request-ID: req-0cd1c8a3-b799-406a-9ccd-09f57af30b87) Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.462347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:06:52.463733 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dbc10109-8c58-4ce0-9453-44c5f30c9614 could not be found. Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 00:06:52.465371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dbc10109-8c58-4ce0-9453-44c5f30c9614 could not be found. Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dbc10109-8c58-4ce0-9453-44c5f30c9614 could not be found. Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c2138d20-9e24-4f98-bfa3-cdbbd21010a7 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Returning 404 to user: Snapshot dbc10109-8c58-4ce0-9453-44c5f30c9614 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:52.466859 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c2138d20-9e24-4f98-bfa3-cdbbd21010a7 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614" status: 404 len: 111 microversion: 2.1 time: 0.034173 Aug 30 00:06:52.467849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 473/913] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 30 00:06:52 2022] GET /compute/v2.1/os-snapshots/dbc10109-8c58-4ce0-9453-44c5f30c9614 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:52.469549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-55c2dfe2-2cb0-491b-b2e6-beddc7300289 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf155af0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:52.646093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-55c2dfe2-2cb0-491b-b2e6-beddc7300289 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 202 len: 0 microversion: 2.1 time: 0.180301 Aug 30 00:06:52.646698 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 441/914] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:06:52 2022] DELETE /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:06:52.656228 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c1a56f78-a987-4ed0-91e4-121836e781ca tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf3430d0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:52.702832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c1a56f78-a987-4ed0-91e4-121836e781ca tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 200 len: 345 microversion: 2.1 time: 0.051194 Aug 30 00:06:52.703401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 474/915] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:52 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:52.740014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:52.740513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:52.747194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.747673 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.748110 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.748793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.749245 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.749669 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.762709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d HTTP/1.1 Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:52.764223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.765653 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '365f024a-9d96-469a-99df-f5bb6ce93c3d'} Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:52.766542 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.768004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.769538 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:52.769538 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-cfabd534-590c-466d-9dd4-1a6c76f49af7 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 404 len: 111 microversion: 2.1 time: 0.029475 Aug 30 00:06:52.769538 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 442/916] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:52 2022] DELETE /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:52.774151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:52.774804 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 365f024a-9d96-469a-99df-f5bb6ce93c3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:52.781332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.781807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.782235 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.782967 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.783414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.783834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.797225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d HTTP/1.1 Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:52.798758 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.800313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '365f024a-9d96-469a-99df-f5bb6ce93c3d'} Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:52.801224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. Aug 30 00:06:52.802722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.804036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance 365f024a-9d96-469a-99df-f5bb6ce93c3d could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:52.804036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-66d146bf-af7c-491a-a0c1-28d7e552544b tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d" status: 404 len: 111 microversion: 2.1 time: 0.029820 Aug 30 00:06:52.804036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 475/917] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:52 2022] GET /compute/v2.1/servers/365f024a-9d96-469a-99df-f5bb6ce93c3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:52.808673 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:52.809241 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:52.814997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.815474 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.815903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.816588 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.817038 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.817456 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.830489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c HTTP/1.1 Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:52.832000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.833503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '7d2e61a5-53b5-471d-994c-e914bc29062c'} Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:52.834383 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.835997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.838198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:52.838198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-578d0d5a-cc75-47a0-8d89-4156fdb913f4 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 404 len: 111 microversion: 2.1 time: 0.028620 Aug 30 00:06:52.838198 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 443/918] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:52 2022] DELETE /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:52.842950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:52.843605 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: 7d2e61a5-53b5-471d-994c-e914bc29062c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:52.849526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.850009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.850494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.851172 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:52.851624 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:52.852051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:52.867839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c HTTP/1.1 Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:52.869462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.871059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '7d2e61a5-53b5-471d-994c-e914bc29062c'} Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:52.872049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. Aug 30 00:06:52.873570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:52.875029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance 7d2e61a5-53b5-471d-994c-e914bc29062c could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:52.875029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d4461897-9ce7-444e-9ced-9a00eed46b1a tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c" status: 404 len: 111 microversion: 2.1 time: 0.031806 Aug 30 00:06:52.875029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 476/919] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:52 2022] GET /compute/v2.1/servers/7d2e61a5-53b5-471d-994c-e914bc29062c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:53.716960 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ac3c7732-65c1-41e8-9989-c230e4292972 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf1c9670>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:53.764128 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ac3c7732-65c1-41e8-9989-c230e4292972 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 200 len: 345 microversion: 2.1 time: 0.051424 Aug 30 00:06:53.764689 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 444/920] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:53 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:06:54.778123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2b236b95-0d4c-49c3-a57f-72412be10043 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf7f23a0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:54.825885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2b236b95-0d4c-49c3-a57f-72412be10043 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 200 len: 345 microversion: 2.1 time: 0.051621 Aug 30 00:06:54.826462 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 477/921] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:54 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:55.839762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-831e7a51-31f1-43fa-8eb7-10aa632f3fd8 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf155ee0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:55.887073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-831e7a51-31f1-43fa-8eb7-10aa632f3fd8 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 200 len: 345 microversion: 2.1 time: 0.051694 Aug 30 00:06:55.887637 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 445/922] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:55 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:56.901268 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4253713f-9108-442f-9068-c3cd25ff4cee tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09c2ada310>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:56.959300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4253713f-9108-442f-9068-c3cd25ff4cee tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 200 len: 345 microversion: 2.1 time: 0.061939 Aug 30 00:06:56.960074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 478/923] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:56 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:57.974516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a7dadeeb-1031-41de-8b16-b3d632707df2 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf132280>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:58.011430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-a7dadeeb-1031-41de-8b16-b3d632707df2 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] HTTP exception thrown: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a7dadeeb-1031-41de-8b16-b3d632707df2 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Request method failure captured: Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e HTTP/1.1 Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVSVygisYLTs62vPo-SGjAPBlvmqy4Uy0X27JmTjCwDQJ_sOpdja5Q-z7IiOGR_WWPpyuAAVWDCHOwXkHkA2jJ6_rGhdudVAqgnqGRWDP3kSYhRgnBG1m_ZdjZmoVESqaN4ligbjxcgYXwgEoAsovWKK3AhqYNLu0uV0SygDKssisvU Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:58.013825 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faf59cc423140208cdbb295c8298807"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faf59cc423140208cdbb295c8298807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}] Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 480ae3d446b14beea47a1c9aefbcab67 Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '8c733c94-3395-4340-8a88-ac0c18c9479e'} Aug 30 00:06:58.015513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. (HTTP 404) (Request-ID: req-fe282ba1-6a8e-48e7-9875-e95d1089483b) Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.016461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:06:58.017826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:06:58.019053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a7dadeeb-1031-41de-8b16-b3d632707df2 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Returning 404 to user: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a7dadeeb-1031-41de-8b16-b3d632707df2 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 404 len: 109 microversion: 2.1 time: 0.045248 Aug 30 00:06:58.020293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 446/924] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:57 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:58.030626 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1bfe38d7-20ac-48bb-b208-d22049e4ef24 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf38c280>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:58.059560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-1bfe38d7-20ac-48bb-b208-d22049e4ef24 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] HTTP exception thrown: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1bfe38d7-20ac-48bb-b208-d22049e4ef24 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Request method failure captured: Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: DELETE /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e HTTP/1.1 Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVSVygisYLTs62vPo-SGjAPBlvmqy4Uy0X27JmTjCwDQJ_sOpdja5Q-z7IiOGR_WWPpyuAAVWDCHOwXkHkA2jJ6_rGhdudVAqgnqGRWDP3kSYhRgnBG1m_ZdjZmoVESqaN4ligbjxcgYXwgEoAsovWKK3AhqYNLu0uV0SygDKssisvU Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:58.061867 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faf59cc423140208cdbb295c8298807"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faf59cc423140208cdbb295c8298807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}] Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 480ae3d446b14beea47a1c9aefbcab67 Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '8c733c94-3395-4340-8a88-ac0c18c9479e'} Aug 30 00:06:58.063659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. (HTTP 404) (Request-ID: req-d989877d-8d5c-44e0-bb13-3dce0bb92cbd) Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.067179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:06:58.068613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 00:06:58.070009 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1bfe38d7-20ac-48bb-b208-d22049e4ef24 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Returning 404 to user: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1bfe38d7-20ac-48bb-b208-d22049e4ef24 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 404 len: 109 microversion: 2.1 time: 0.037440 Aug 30 00:06:58.071429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 479/925] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:06:58 2022] DELETE /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:06:58.073061 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7fb26ee7-e8d7-42e9-b468-9d8a81b07918 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Calling method '.version_select at 0x7f09bf18f820>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:58.100580 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-7fb26ee7-e8d7-42e9-b468-9d8a81b07918 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] HTTP exception thrown: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7fb26ee7-e8d7-42e9-b468-9d8a81b07918 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Request method failure captured: Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e HTTP/1.1 Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVSVygisYLTs62vPo-SGjAPBlvmqy4Uy0X27JmTjCwDQJ_sOpdja5Q-z7IiOGR_WWPpyuAAVWDCHOwXkHkA2jJ6_rGhdudVAqgnqGRWDP3kSYhRgnBG1m_ZdjZmoVESqaN4ligbjxcgYXwgEoAsovWKK3AhqYNLu0uV0SygDKssisvU Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:58.102508 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8faf59cc423140208cdbb295c8298807"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8faf59cc423140208cdbb295c8298807"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8faf59cc423140208cdbb295c8298807"}]}] Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 8faf59cc423140208cdbb295c8298807 Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1975832936 Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 480ae3d446b14beea47a1c9aefbcab67 Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1975832936-project Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '8c733c94-3395-4340-8a88-ac0c18c9479e'} Aug 30 00:06:58.104136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. (HTTP 404) (Request-ID: req-3ff2fb65-531e-4e90-860e-fab788ec5166) Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.105210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:06:58.106701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:06:58.108226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7fb26ee7-e8d7-42e9-b468-9d8a81b07918 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] Returning 404 to user: Volume 8c733c94-3395-4340-8a88-ac0c18c9479e could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7fb26ee7-e8d7-42e9-b468-9d8a81b07918 tempest-VolumesSnapshotsTestJSON-1975832936 tempest-VolumesSnapshotsTestJSON-1975832936-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e" status: 404 len: 109 microversion: 2.1 time: 0.035734 Aug 30 00:06:58.109655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 447/926] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:06:58 2022] GET /compute/v2.1/os-volumes/8c733c94-3395-4340-8a88-ac0c18c9479e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:58.429742 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:58.430330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:58.437072 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:58.437550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:58.437991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:58.438701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:58.439151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:58.439569 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:58.452509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: DELETE /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 HTTP/1.1 Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:06:58.454029 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.455693 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'a9105900-32ff-4338-bffd-cdf09407a6a6'} Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:58.456668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.458142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.460038 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:58.460038 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-080a14d0-fef1-4670-8a8c-f07fdd7b069d tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 404 len: 111 microversion: 2.1 time: 0.029870 Aug 30 00:06:58.460038 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 480/927] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:06:58 2022] DELETE /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:06:58.464208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:58.465723 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] [instance: a9105900-32ff-4338-bffd-cdf09407a6a6] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:58.470832 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:58.471311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:58.471746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:58.472432 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:58.472884 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:58.473333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:58.486886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] HTTP exception thrown: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Request method failure captured: Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 HTTP/1.1 Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVNDgrn_SWM2nixX0JWEHWv0y6RQrnBCUrMqV1d59C_OS--JlAHo1lq5hP2RgAS_8y5QGiWGUWKSCrLhmGdzh3wXbTbmqSGCbIQaR3lbBNSIrZaPwi4Co_-Fm7xcLGekNE3zUzAVIaAvJCCQvNbgDeRJ3iT5nvm51jnOtztKfCuwjkw Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:06:58.488476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6c19a4c87f3f4a3390cec0c13eadc084"}]}] Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 6c19a4c87f3f4a3390cec0c13eadc084 Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-279632569 Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: f144bc14d1464de6befc9061ca159dbc Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-AttachVolumeNegativeTest-279632569-project Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.490100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'a9105900-32ff-4338-bffd-cdf09407a6a6'} Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:06:58.491635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. Aug 30 00:06:58.495439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:06:58.497237 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] Returning 404 to user: Instance a9105900-32ff-4338-bffd-cdf09407a6a6 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:06:58.497237 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d4f3bb53-1f8b-41bf-bd1f-bd3c576ee623 tempest-AttachVolumeNegativeTest-279632569 tempest-AttachVolumeNegativeTest-279632569-project] 10.222.0.60 "GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6" status: 404 len: 111 microversion: 2.1 time: 0.029471 Aug 30 00:06:58.497237 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 448/928] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:58 2022] GET /compute/v2.1/servers/a9105900-32ff-4338-bffd-cdf09407a6a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:07:04.711759 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d9b622a5-9d63-4ef1-b86c-b7ffe33335ad tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Action: 'create', calling method: .version_select at 0x7f09bf6afb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-762692388", "metadata": {"Type": "work"}}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d9b622a5-9d63-4ef1-b86c-b7ffe33335ad tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Request method failure captured: Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 121 Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVSonWyAx75NbZNl0TzjkiGnlKmp20sROlDaPz9Wn0pWI6ZG-_EenHq6tQrW5eeD4timTp4c5jzxJ3l79MzTxw0p22Me82WvCUPZ0UZxICFuxX1Ln9zgi8vpw8QyLFUcAAMkXhaHFv66Q60NzSpjaim0B_OjNKeB8CbqcUtwPJ7IBR0 Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:07:04.727284 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5eac30992db047b5974d25b62efa3a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}] Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: df8293eba8c14ca99bb4cb38b158319a Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-762692388", "metadata": {"Type": "work"}}} Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: Aug 30 00:07:04.732830 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-762692388', 'metadata': {'Type': 'work'}}}} Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise error Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:04.733664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 00:07:04.735269 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 00:07:04.736627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 00:07:04.736627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.736627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d9b622a5-9d63-4ef1-b86c-b7ffe33335ad tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:04.736627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d9b622a5-9d63-4ef1-b86c-b7ffe33335ad tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129404 Aug 30 00:07:04.736627 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 481/929] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Aug 30 00:07:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:07:04.739420 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eaaa0f69-2e22-42e5-a266-f20d659447a3 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Action: 'create', calling method: .version_select at 0x7f09bf155700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1543171525", "metadata": {"Type": "work"}}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eaaa0f69-2e22-42e5-a266-f20d659447a3 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Request method failure captured: Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 120 Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVSonWyAx75NbZNl0TzjkiGnlKmp20sROlDaPz9Wn0pWI6ZG-_EenHq6tQrW5eeD4timTp4c5jzxJ3l79MzTxw0p22Me82WvCUPZ0UZxICFuxX1Ln9zgi8vpw8QyLFUcAAMkXhaHFv66Q60NzSpjaim0B_OjNKeB8CbqcUtwPJ7IBR0 Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:07:04.744146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5eac30992db047b5974d25b62efa3a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}] Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: df8293eba8c14ca99bb4cb38b158319a Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1543171525", "metadata": {"Type": "work"}}} Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: Aug 30 00:07:04.745709 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1543171525', 'metadata': {'Type': 'work'}}}} Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise error Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi '0' Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:04.746670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 00:07:04.748321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 00:07:04.749761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 00:07:04.749761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.749761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-eaaa0f69-2e22-42e5-a266-f20d659447a3 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:04.749761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-eaaa0f69-2e22-42e5-a266-f20d659447a3 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010232 Aug 30 00:07:04.749761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 449/930] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Aug 30 00:07:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-27cd849c-6209-41ed-9d61-6a643f368ac2 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Action: 'create', calling method: .version_select at 0x7f09bf36bee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1699495329", "metadata": {"Type": "work"}}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-27cd849c-6209-41ed-9d61-6a643f368ac2 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Request method failure captured: Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 119 Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVSonWyAx75NbZNl0TzjkiGnlKmp20sROlDaPz9Wn0pWI6ZG-_EenHq6tQrW5eeD4timTp4c5jzxJ3l79MzTxw0p22Me82WvCUPZ0UZxICFuxX1Ln9zgi8vpw8QyLFUcAAMkXhaHFv66Q60NzSpjaim0B_OjNKeB8CbqcUtwPJ7IBR0 Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:07:04.761002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5eac30992db047b5974d25b62efa3a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}] Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: df8293eba8c14ca99bb4cb38b158319a Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1699495329", "metadata": {"Type": "work"}}} Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: Aug 30 00:07:04.762619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1699495329', 'metadata': {'Type': 'work'}}}} Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise error Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi '' Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:04.763614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 00:07:04.765412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 00:07:04.766840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 00:07:04.766840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.766840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-27cd849c-6209-41ed-9d61-6a643f368ac2 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:04.766840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-27cd849c-6209-41ed-9d61-6a643f368ac2 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009898 Aug 30 00:07:04.766840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 482/931] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Aug 30 00:07:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:07:04.771572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2ec98e1b-d9d8-4cea-a8da-28a873e23d16 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Calling method '.version_select at 0x7f09bf16b040>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:04.803455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-2ec98e1b-d9d8-4cea-a8da-28a873e23d16 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] HTTP exception thrown: Volume tempest-invalid-395456774 could not be found. Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2ec98e1b-d9d8-4cea-a8da-28a873e23d16 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Request method failure captured: Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-395456774 HTTP/1.1 Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVSonWyAx75NbZNl0TzjkiGnlKmp20sROlDaPz9Wn0pWI6ZG-_EenHq6tQrW5eeD4timTp4c5jzxJ3l79MzTxw0p22Me82WvCUPZ0UZxICFuxX1Ln9zgi8vpw8QyLFUcAAMkXhaHFv66Q60NzSpjaim0B_OjNKeB8CbqcUtwPJ7IBR0 Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:07:04.805416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5eac30992db047b5974d25b62efa3a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}] Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: df8293eba8c14ca99bb4cb38b158319a Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Volume tempest-invalid-395456774 could not be found. Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'tempest-invalid-395456774'} Aug 30 00:07:04.807032 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-395456774 could not be found. (HTTP 404) (Request-ID: req-382f8a90-c8b9-4058-a04a-88215a94d4bb) Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.808060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:07:04.809535 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-395456774 could not be found. Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:07:04.811065 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-395456774 could not be found. Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-395456774 could not be found. Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2ec98e1b-d9d8-4cea-a8da-28a873e23d16 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Returning 404 to user: Volume tempest-invalid-395456774 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2ec98e1b-d9d8-4cea-a8da-28a873e23d16 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-395456774" status: 404 len: 98 microversion: 2.1 time: 0.039680 Aug 30 00:07:04.812679 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 450/932] 10.222.0.60 () {58 vars in 1215 bytes} [Tue Aug 30 00:07:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-395456774 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 00:07:04.817916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7d86d624-f659-490c-802a-7ba38a1d7d28 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003804 Aug 30 00:07:04.818405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 483/933] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Aug 30 00:07:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 00:07:04.830688 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d4ae2d4b-43fc-4a7a-8ad5-4aba89b63365 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003880 Aug 30 00:07:04.831183 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 451/934] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Aug 30 00:07:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 00:07:04.840214 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-89d5a0e0-c72a-4e72-8057-fd5ad212b0f5 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Calling method '.version_select at 0x7f09bf6afdc0>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:04.867913 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-89d5a0e0-c72a-4e72-8057-fd5ad212b0f5 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] HTTP exception thrown: Volume 0b1aeeb6-da51-43e3-87a8-29f5cff87fdb could not be found. Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-89d5a0e0-c72a-4e72-8057-fd5ad212b0f5 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Request method failure captured: Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: DELETE /compute/v2.1/os-volumes/0b1aeeb6-da51-43e3-87a8-29f5cff87fdb HTTP/1.1 Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVSonWyAx75NbZNl0TzjkiGnlKmp20sROlDaPz9Wn0pWI6ZG-_EenHq6tQrW5eeD4timTp4c5jzxJ3l79MzTxw0p22Me82WvCUPZ0UZxICFuxX1Ln9zgi8vpw8QyLFUcAAMkXhaHFv66Q60NzSpjaim0B_OjNKeB8CbqcUtwPJ7IBR0 Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:07:04.872815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5eac30992db047b5974d25b62efa3a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}] Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: df8293eba8c14ca99bb4cb38b158319a Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Volume 0b1aeeb6-da51-43e3-87a8-29f5cff87fdb could not be found. Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '0b1aeeb6-da51-43e3-87a8-29f5cff87fdb'} Aug 30 00:07:04.874379 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b1aeeb6-da51-43e3-87a8-29f5cff87fdb could not be found. (HTTP 404) (Request-ID: req-8c4bc541-a352-4689-8c8d-eafec27e479c) Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.875450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:07:04.876710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b1aeeb6-da51-43e3-87a8-29f5cff87fdb could not be found. Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 00:07:04.878150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b1aeeb6-da51-43e3-87a8-29f5cff87fdb could not be found. Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b1aeeb6-da51-43e3-87a8-29f5cff87fdb could not be found. Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-89d5a0e0-c72a-4e72-8057-fd5ad212b0f5 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Returning 404 to user: Volume 0b1aeeb6-da51-43e3-87a8-29f5cff87fdb could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-89d5a0e0-c72a-4e72-8057-fd5ad212b0f5 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/0b1aeeb6-da51-43e3-87a8-29f5cff87fdb" status: 404 len: 109 microversion: 2.1 time: 0.035564 Aug 30 00:07:04.879550 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 484/935] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 30 00:07:04 2022] DELETE /compute/v2.1/os-volumes/0b1aeeb6-da51-43e3-87a8-29f5cff87fdb => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:07:04.881857 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-24ab7106-e4a2-4ca8-8bad-438f00fc1159 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Calling method '.version_select at 0x7f09bf155d30>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:04.909670 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-24ab7106-e4a2-4ca8-8bad-438f00fc1159 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] HTTP exception thrown: Volume 90be37cb-3755-4a65-9688-acdba903a142 could not be found. Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-24ab7106-e4a2-4ca8-8bad-438f00fc1159 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Request method failure captured: Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/os-volumes/90be37cb-3755-4a65-9688-acdba903a142 HTTP/1.1 Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVSonWyAx75NbZNl0TzjkiGnlKmp20sROlDaPz9Wn0pWI6ZG-_EenHq6tQrW5eeD4timTp4c5jzxJ3l79MzTxw0p22Me82WvCUPZ0UZxICFuxX1Ln9zgi8vpw8QyLFUcAAMkXhaHFv66Q60NzSpjaim0B_OjNKeB8CbqcUtwPJ7IBR0 Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:07:04.911742 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5eac30992db047b5974d25b62efa3a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5eac30992db047b5974d25b62efa3a96"}]}] Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 5eac30992db047b5974d25b62efa3a96 Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesNegativeTest-863064157 Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: df8293eba8c14ca99bb4cb38b158319a Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesNegativeTest-863064157-project Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Volume 90be37cb-3755-4a65-9688-acdba903a142 could not be found. Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '90be37cb-3755-4a65-9688-acdba903a142'} Aug 30 00:07:04.913329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90be37cb-3755-4a65-9688-acdba903a142 could not be found. (HTTP 404) (Request-ID: req-d02b188c-0c03-4bd6-bb49-935d0336dee0) Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.914211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:07:04.919523 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90be37cb-3755-4a65-9688-acdba903a142 could not be found. Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:07:04.921184 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90be37cb-3755-4a65-9688-acdba903a142 could not be found. Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90be37cb-3755-4a65-9688-acdba903a142 could not be found. Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-24ab7106-e4a2-4ca8-8bad-438f00fc1159 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] Returning 404 to user: Volume 90be37cb-3755-4a65-9688-acdba903a142 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-24ab7106-e4a2-4ca8-8bad-438f00fc1159 tempest-VolumesNegativeTest-863064157 tempest-VolumesNegativeTest-863064157-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/90be37cb-3755-4a65-9688-acdba903a142" status: 404 len: 109 microversion: 2.1 time: 0.035286 Aug 30 00:07:04.922694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 452/936] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 30 00:07:04 2022] GET /compute/v2.1/os-volumes/90be37cb-3755-4a65-9688-acdba903a142 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:07:32.130952 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:32.131892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:32.136324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:32.136531 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:32.137039 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:32.137485 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:32.141587 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-fc9be798-35c3-49ac-b30c-c6621cd831e4 req-2fb39bed-f444-455b-93c3-b9d0add779c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a7c39c-c5e6-4553-be70-454ad70a50da", "tag": "a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:07:32.147355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:32.148407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:32.149032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:32.150014 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:32.150660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:32.150788 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-fc9be798-35c3-49ac-b30c-c6621cd831e4 req-2fb39bed-f444-455b-93c3-b9d0add779c4 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:32.155406 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-fc9be798-35c3-49ac-b30c-c6621cd831e4 req-2fb39bed-f444-455b-93c3-b9d0add779c4 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:32.155551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:32.155644 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-fc9be798-35c3-49ac-b30c-c6621cd831e4 req-2fb39bed-f444-455b-93c3-b9d0add779c4 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:32.162800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-fc9be798-35c3-49ac-b30c-c6621cd831e4 req-2fb39bed-f444-455b-93c3-b9d0add779c4 service nova] Creating event network-changed:a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802 for instance d0a7c39c-c5e6-4553-be70-454ad70a50da on hv-cinder-85427 Aug 30 00:07:32.168982 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-fc9be798-35c3-49ac-b30c-c6621cd831e4 req-2fb39bed-f444-455b-93c3-b9d0add779c4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035120 Aug 30 00:07:32.169581 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 453/937] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:07:32.192003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:07:32.475657 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0a239139-14ba-473f-93c6-62191f371202 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 204 len: 0 microversion: 2.1 time: 0.345627 Aug 30 00:07:32.476477 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 485/938] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:07:32 2022] DELETE /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:07:32.486239 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:32.486881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:32.494891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:32.496019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:32.496468 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:32.497179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:32.497634 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:32.498055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:32.640185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:32.651190 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-502205f6-01ae-4c83-b6dc-4a807c83b089 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.170191 Aug 30 00:07:32.652107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 454/939] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:32 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:33.674172 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:33.674969 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:33.682854 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:33.683338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:33.684411 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:33.685104 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:33.685595 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:33.686022 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:33.825278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:33.833438 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-366ccfe2-46ca-41e3-8043-6ba055370bc0 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.163414 Aug 30 00:07:33.833999 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 486/940] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:33 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:34.857317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:34.857317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:34.863375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:34.863860 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:34.864289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:34.864991 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:34.865450 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:34.865876 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:35.034992 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:35.044023 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fe76d3d6-d29e-41c0-b075-9b9cf6e8de23 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.192135 Aug 30 00:07:35.045012 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 455/941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:34 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:36.065938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:36.066606 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:36.073286 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:36.078308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:36.078308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:36.078308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:36.078308 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:36.078829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:36.213440 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:36.221508 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dfee888e-2d8a-422d-a752-5531947fb026 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.159418 Aug 30 00:07:36.222372 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 487/942] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:36 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:37.242270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:37.242913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:37.249929 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:37.250410 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:37.250870 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:37.251561 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:37.252014 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:37.252439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:37.394494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:37.402765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e649cac1-a716-46d4-a0cb-195225adc973 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.164285 Aug 30 00:07:37.403472 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 456/943] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:37 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:38.429025 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:38.429641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:38.436622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:38.437106 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:38.437540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:38.438232 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:38.438748 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:38.439174 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:38.584382 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:38.592924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f76d2bc8-327f-43ee-85cb-a247fe76415a tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1570 microversion: 2.1 time: 0.168247 Aug 30 00:07:38.593506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 488/944] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:38 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:07:39.447086 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-d471199b-d6a1-43f3-9118-3a8b2238d7c4 req-76e1120b-8de9-493b-9796-710e02d57ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a7c39c-c5e6-4553-be70-454ad70a50da", "name": "network-vif-deleted", "tag": "a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:07:39.458203 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-d471199b-d6a1-43f3-9118-3a8b2238d7c4 req-76e1120b-8de9-493b-9796-710e02d57ab3 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:39.458690 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-d471199b-d6a1-43f3-9118-3a8b2238d7c4 req-76e1120b-8de9-493b-9796-710e02d57ab3 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:39.459114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-d471199b-d6a1-43f3-9118-3a8b2238d7c4 req-76e1120b-8de9-493b-9796-710e02d57ab3 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:39.472260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-d471199b-d6a1-43f3-9118-3a8b2238d7c4 req-76e1120b-8de9-493b-9796-710e02d57ab3 service nova] Creating event network-vif-deleted:a4c1da0e-e8b0-4aa1-bc1f-8d5a5119f802 for instance d0a7c39c-c5e6-4553-be70-454ad70a50da on hv-cinder-85427 Aug 30 00:07:39.477294 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-d471199b-d6a1-43f3-9118-3a8b2238d7c4 req-76e1120b-8de9-493b-9796-710e02d57ab3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034031 Aug 30 00:07:39.478233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 457/945] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:07:39.613787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:39.614415 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:39.620845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:39.621468 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:39.621898 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:39.622612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:39.623069 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:39.623493 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:39.685982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:39.693712 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-04c055a2-8016-44ae-a9bc-081d51835280 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1220 microversion: 2.1 time: 0.083796 Aug 30 00:07:39.694274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 489/946] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:39 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:40.716480 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:40.717104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:40.723956 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:40.728039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:40.728039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:40.728039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:40.728039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:40.728428 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:40.757322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:40.757817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:40.758236 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:40.758706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lazy-loading 'fault' on Instance uuid d0a7c39c-c5e6-4553-be70-454ad70a50da {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:07:40.804225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bc0a546aa34f1797dcf042306a8213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eba2c58985143d9980157003e964772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:40.812283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-85aef17e-7dee-4c14-acdb-053be424655c tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 200 len: 1225 microversion: 2.1 time: 0.100873 Aug 30 00:07:40.812859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 458/947] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:40 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:41.833530 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:41.841956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] [instance: d0a7c39c-c5e6-4553-be70-454ad70a50da] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:41.841956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:41.842265 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:41.842539 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:41.843246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:41.843710 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:41.844136 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:41.858809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] HTTP exception thrown: Instance d0a7c39c-c5e6-4553-be70-454ad70a50da could not be found. Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Request method failure captured: Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da HTTP/1.1 Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVOiMeSSzdL4denksfRs8CUUIkaT-tC70tEf0HUxMsF7uizQaquNP5B2Y77GZ8rkuocTfIuDdNx5El2TLTeSBPkXUugzbO9WbZAnYhT-8trbWyNCrUnKv6MoHl6Bc-WOrI2gUbbzn7xpwoSthT7lmZ_gRfbOGvx_Ccy2cbNROAPnEqk Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 1eba2c58985143d9980157003e964772 Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-TestShelveInstance-1618500164 Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:07:41.860491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1eba2c58985143d9980157003e964772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1eba2c58985143d9980157003e964772"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1eba2c58985143d9980157003e964772"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1eba2c58985143d9980157003e964772"}]}] Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-TestShelveInstance-1618500164 Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 1eba2c58985143d9980157003e964772 Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-TestShelveInstance-1618500164 Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-TestShelveInstance-1618500164-project Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: c0bc0a546aa34f1797dcf042306a8213 Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-TestShelveInstance-1618500164-project Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance d0a7c39c-c5e6-4553-be70-454ad70a50da could not be found. Aug 30 00:07:41.862275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'd0a7c39c-c5e6-4553-be70-454ad70a50da'} Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a7c39c-c5e6-4553-be70-454ad70a50da could not be found. Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:41.863469 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a7c39c-c5e6-4553-be70-454ad70a50da could not be found. Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a7c39c-c5e6-4553-be70-454ad70a50da could not be found. Aug 30 00:07:41.865141 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:07:41.871968 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Returning 404 to user: Instance d0a7c39c-c5e6-4553-be70-454ad70a50da could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:41.871968 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-645ba888-ef33-4b2f-af94-a63db8034453 tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da" status: 404 len: 111 microversion: 2.1 time: 0.032541 Aug 30 00:07:41.871968 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 490/948] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:41 2022] GET /compute/v2.1/servers/d0a7c39c-c5e6-4553-be70-454ad70a50da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:07:42.109678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b4afcdee-8b6f-4d88-bb1f-cb80a989a7ba tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] Calling method '.version_select at 0x7f09bf1324c0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:42.252437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b4afcdee-8b6f-4d88-bb1f-cb80a989a7ba tempest-TestShelveInstance-1618500164 tempest-TestShelveInstance-1618500164-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2137386977" status: 202 len: 0 microversion: 2.1 time: 0.147522 Aug 30 00:07:42.253258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 459/949] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Aug 30 00:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2137386977 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:08:07.815129 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:07.815884 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:08.067362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-20422193-7d9f-450b-9d77-42bd35204658 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Action: 'create', calling method: .version_select at 0x7f09c0b07790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-870002560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvUnCwS7gsMDaskszoWDSCsjvQP0aUGUOqffjyS5CJAqG0/iXvhk6Vh50U4XPh32HTXyFkS7Vzuetx7ncHevkHuLmNYw+F1++/c3rFnZQxgUAC1CnC3NAFakz4ZattcHw=="}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:08.093252 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-20422193-7d9f-450b-9d77-42bd35204658 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:08:08.105526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-20422193-7d9f-450b-9d77-42bd35204658 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for user ca4e4437fa0c4b03ac2f8c3d2aa1589f and project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'key_pairs'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:08:08.186786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-20422193-7d9f-450b-9d77-42bd35204658 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.386894 Aug 30 00:08:08.188058 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 491/950] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:08:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:27.720926 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9c419b12-f9b8-483f-ac60-7e6168d98b5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Action: 'create', calling method: .version_select at 0x7f09bf155b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-189467714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTgVa3SHqwSqnw64yD9VyRzuxWeEXePNROHHLm8OYaeqRpeeGlnMNRdO3XCZSSFisDuS2R1CHUgJQq7kQUWXgkxGOXrR+bDoAMMPPAtRVAhQTfI+SOrbVX4uW8LKa8wOw=="}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:27.726511 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=30 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:27.727168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:27.739697 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-9c419b12-f9b8-483f-ac60-7e6168d98b5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Getting quotas for project b8de2818d269420b84f3fb8a18781ed3. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:08:27.743439 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-9c419b12-f9b8-483f-ac60-7e6168d98b5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Getting quotas for user 8e07e41fba924b8d9ddc6878f2aefb8c and project b8de2818d269420b84f3fb8a18781ed3. Resources: {'key_pairs'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:08:27.853815 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9c419b12-f9b8-483f-ac60-7e6168d98b5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136715 Aug 30 00:08:27.854657 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 460/951] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 30 00:08:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:08:27.967850 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:08:27.968432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Tue Aug 30 00:08:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 30 00:08:27.969127 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=4 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:27.970245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:27.976035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1961945597", "imageRef": "8ca82bba-d71c-42f0-94b9-f18c850bd932", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-189467714", "networks": [{"uuid": "7b4cde24-5846-4916-94d9-2383b9445285"}]}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:28.042427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] validate_networks() for [('7b4cde24-5846-4916-94d9-2383b9445285', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:08:28.059067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-42571739", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-870002560", "security_groups": [{"name": "tempest-secgroup-smoke-733249467"}], "block_device_mapping_v2": [{"uuid": "4874a7ec-755e-46ef-b94e-0578d064eb01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8319b568-7e64-4b20-bb37-86ff7df63aca"}]}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:28.184526 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] validate_networks() for [('8319b568-7e64-4b20-bb37-86ff7df63aca', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:08:28.554150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:08:28.554770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:08:28.555412 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:08:28.555818 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:08:28.556225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:08:28.565083 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:28.565558 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:28.565982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:28.566725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:28.567722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:28.567863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:28.586315 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Getting quotas for project b8de2818d269420b84f3fb8a18781ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:08:28.588233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:08:28.588657 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:08:28.589127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:08:28.589533 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:08:28.589942 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:08:28.590309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Getting quotas for user 8e07e41fba924b8d9ddc6878f2aefb8c and project b8de2818d269420b84f3fb8a18781ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:08:28.599529 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:28.599950 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:28.600378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:28.601239 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:28.601698 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:28.601831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:08:28.602120 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:28.604109 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8ca82bba-d71c-42f0-94b9-f18c850bd932',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:08:28.620688 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:08:28.624750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for user ca4e4437fa0c4b03ac2f8c3d2aa1589f and project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:08:28.682976 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:08:28.685310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4874a7ec-755e-46ef-b94e-0578d064eb01',volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:08:28.736471 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-73f74dfe-784f-4d2c-a7ae-ff0ada32c64c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770172 Aug 30 00:08:28.737002 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 492/952] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:08:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:08:28.749468 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7a4c2936-b204-4bf0-b2e2-9ac867739f8f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:28.750078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7a4c2936-b204-4bf0-b2e2-9ac867739f8f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:28.807551 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7a4c2936-b204-4bf0-b2e2-9ac867739f8f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:28.815138 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7a4c2936-b204-4bf0-b2e2-9ac867739f8f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1258 microversion: 2.1 time: 0.069646 Aug 30 00:08:28.815942 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 493/953] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:28 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:29.162206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-44e3f681-5989-4922-b5a8-35c28df7cb5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.107073 Aug 30 00:08:29.162890 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 461/954] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:08:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 00:08:29.173930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3ba39d6c-f2f5-4743-b127-f0d9a14c9c26 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:29.175434 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3ba39d6c-f2f5-4743-b127-f0d9a14c9c26 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:29.232747 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3ba39d6c-f2f5-4743-b127-f0d9a14c9c26 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:29.239890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3ba39d6c-f2f5-4743-b127-f0d9a14c9c26 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1092 microversion: 2.1 time: 0.070032 Aug 30 00:08:29.253242 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 494/955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:29 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1092 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:29.837424 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6fe4e7e3-0f71-42a1-860f-8db7bf825660 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:29.838039 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6fe4e7e3-0f71-42a1-860f-8db7bf825660 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:29.902645 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fe4e7e3-0f71-42a1-860f-8db7bf825660 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:29.910624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6fe4e7e3-0f71-42a1-860f-8db7bf825660 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1258 microversion: 2.1 time: 0.077604 Aug 30 00:08:29.911199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 462/956] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:29 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:30.260928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7498f795-b95b-4377-9e4e-fd266868deaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:30.261535 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7498f795-b95b-4377-9e4e-fd266868deaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:30.318435 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7498f795-b95b-4377-9e4e-fd266868deaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:30.325376 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7498f795-b95b-4377-9e4e-fd266868deaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1092 microversion: 2.1 time: 0.068639 Aug 30 00:08:30.325933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 495/957] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:30 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:30.931334 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:30.932103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:30.939096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:30.939675 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:30.940201 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:30.940978 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:30.941438 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:30.941864 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:31.006799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:31.016746 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4eebf94b-1ea6-4634-8f77-1b9bf15eec22 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1310 microversion: 2.1 time: 0.089208 Aug 30 00:08:31.017253 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 463/958] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:30 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:31.345378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:31.349143 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:31.353452 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:31.353946 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:31.354381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:31.355102 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:31.355560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:31.356059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:31.419729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:31.427362 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5860cf33-0728-4d11-a5ea-4289ea78e7b3 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1190 microversion: 2.1 time: 0.086107 Aug 30 00:08:31.428040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 496/959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:31 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1190 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:32.037507 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:32.039009 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:32.047485 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:32.047973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:32.048404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:32.049131 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:32.049770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:32.050194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:32.154122 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:32.167826 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-440b8547-26c5-4e9d-8c0e-fc03d7804d5d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1316 microversion: 2.1 time: 0.133785 Aug 30 00:08:32.168640 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 464/960] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:32 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1316 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:32.451629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:32.453067 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:32.466877 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:32.467667 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:32.468293 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:32.469261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:32.469888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:32.470510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:32.580625 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:32.592798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a72f7cb9-85a5-4b7b-88ba-f03e6bad2545 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1208 microversion: 2.1 time: 0.146271 Aug 30 00:08:32.611211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 497/961] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:32 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1208 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:33.191608 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:33.192248 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:33.199506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:33.200351 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:33.201084 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:33.202773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:33.203324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:33.203772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:33.470276 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:33.481551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8157c58c-5657-4670-9f93-2a593d69f392 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.294371 Aug 30 00:08:33.496166 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 465/962] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:33 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:33.619121 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:33.619749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:33.630622 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:33.631702 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:33.632153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:33.632892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:33.633348 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:33.633767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:33.818289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:33.829690 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3f20c8cc-6d03-44c3-8aec-674ac49b279c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1275 microversion: 2.1 time: 0.214942 Aug 30 00:08:33.830273 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 498/963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:33 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:34.504037 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:34.504784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:34.517954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:34.518621 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:34.519129 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:34.519903 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:34.520429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:34.520922 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:34.660533 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:34.668750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-675ee21f-a1f4-4280-aae1-0b7dd87b1116 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.169568 Aug 30 00:08:34.669340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 466/964] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:34 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:34.850593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:34.851343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:34.857803 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:34.858880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:34.859696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:34.860573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:34.861031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:34.861446 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:35.019028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:35.027023 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-72bb2182-0478-42a4-bb2a-7bb6aca32b24 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1275 microversion: 2.1 time: 0.180225 Aug 30 00:08:35.027538 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 499/965] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:34 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:35.689718 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:35.690339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:35.697064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:35.697547 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:35.697983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:35.698720 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:35.699168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:35.699780 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:35.838986 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:35.847624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-834905c2-1e28-4803-8611-18be4318cafd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.162214 Aug 30 00:08:35.848756 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 467/966] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:35 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:36.048192 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:36.048798 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:36.056219 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:36.056458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:36.056810 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:36.057529 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:36.057985 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:36.058666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:36.194150 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:36.202734 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7ab09bd0-673a-4e04-a8f6-68900a7948e4 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1275 microversion: 2.1 time: 0.158431 Aug 30 00:08:36.203321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 500/967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:36 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:36.869399 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:36.870125 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:36.877223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:36.877971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:36.878680 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:36.879646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:36.880099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:36.880521 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:37.023107 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:37.032963 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-30c9c04d-3ea7-4992-ba35-04747c0e3022 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.167430 Aug 30 00:08:37.033751 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 468/968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:36 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:37.224200 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:37.224839 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:37.232250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:37.232743 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:37.233174 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:37.234458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:37.234929 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:37.235350 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:37.391873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:37.400006 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4ad44f2a-e762-4381-88b3-a685e621846a tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1275 microversion: 2.1 time: 0.179738 Aug 30 00:08:37.415011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 501/969] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:37 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:38.054435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:38.055191 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:38.063285 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:38.063833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:38.064331 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:38.065158 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:38.065612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:38.066234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:38.209268 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:38.217954 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4a0dfc82-dcce-4006-bde5-4e6c52047434 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.167339 Aug 30 00:08:38.219840 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 469/970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:38 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:38.422555 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:38.423540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:38.431352 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:38.431860 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:38.432389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:38.433278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:38.433889 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:38.434371 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:38.575705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:38.598114 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:38.606641 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-efa8dd47-95d6-4116-9d75-584d6d6924be tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1275 microversion: 2.1 time: 0.189374 Aug 30 00:08:38.607229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 502/971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:38 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:39.240297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:39.240927 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:39.243067 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:39.248528 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:39.249111 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:39.249598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:39.250346 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:39.250884 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:39.251399 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:39.558874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:39.571084 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-caf9dc19-b581-4138-8294-362a4ec55878 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.334651 Aug 30 00:08:39.572216 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 470/972] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:39 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:39.637656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:39.639078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:39.658538 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:39.660309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:39.660309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:39.660309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:39.660863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:39.663242 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:39.857212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:39.871684 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-89f3dbd5-788a-42e5-8f14-4cb917fefb0e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1275 microversion: 2.1 time: 0.244040 Aug 30 00:08:39.875296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 503/973] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:39 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:40.316329 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-cb2b44cc-43d7-40b5-8f0f-073eab6ca77d req-d1a60e20-6733-4bce-a547-8585e2068bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66588d83-f7ec-4bc5-9fc0-8d23544f2257", "tag": "76ab7d7b-499e-48f0-8a9f-7954b3e4a85a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:40.329325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=12 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:40.333803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-cb2b44cc-43d7-40b5-8f0f-073eab6ca77d req-d1a60e20-6733-4bce-a547-8585e2068bb3 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:40.334603 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-cb2b44cc-43d7-40b5-8f0f-073eab6ca77d req-d1a60e20-6733-4bce-a547-8585e2068bb3 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:40.336052 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-cb2b44cc-43d7-40b5-8f0f-073eab6ca77d req-d1a60e20-6733-4bce-a547-8585e2068bb3 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:40.355635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-cb2b44cc-43d7-40b5-8f0f-073eab6ca77d req-d1a60e20-6733-4bce-a547-8585e2068bb3 service nova] Creating event network-changed:76ab7d7b-499e-48f0-8a9f-7954b3e4a85a for instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 on hv-cinder-85427 Aug 30 00:08:40.364294 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-cb2b44cc-43d7-40b5-8f0f-073eab6ca77d req-d1a60e20-6733-4bce-a547-8585e2068bb3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051888 Aug 30 00:08:40.365560 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 471/974] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:40.595998 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:40.596761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:40.598633 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=12 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:40.603961 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:40.609660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:40.609660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:40.609660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:40.609660 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:40.610010 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:40.744966 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:40.752603 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-765889ed-d107-49dc-8a60-1e81cf17893e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.160528 Aug 30 00:08:40.753178 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 504/975] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:40 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:40.894767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:40.895466 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:40.901759 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:40.902317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:40.902958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:40.903659 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:40.904114 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:40.904540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:41.182396 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:41.190226 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6215c752-4e91-43ef-a6a8-6aaf8abe6fc5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.300487 Aug 30 00:08:41.190835 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 472/976] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:40 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:41.778099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:41.778099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:41.782329 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:41.782845 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:41.783274 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:41.784509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:41.784761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:41.785183 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:41.922272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:41.930664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-497f34ea-77f2-4518-a620-c68ab52d82f6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.160256 Aug 30 00:08:41.931240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 505/977] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:41 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:42.210905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:42.211513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:42.217904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:42.219432 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:42.219432 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:42.219772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:42.220084 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:42.220502 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:42.382149 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-512a08e4-c821-4a7b-9e5b-a21cc9b1ee41 req-463a507a-14f0-4249-8aaf-f29998e3afc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574b6476-5eeb-4eac-be78-7632db94cc3d", "tag": "ce2af983-4ada-48be-85de-0bb55d53e4c6"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:42.393385 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-512a08e4-c821-4a7b-9e5b-a21cc9b1ee41 req-463a507a-14f0-4249-8aaf-f29998e3afc8 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:42.393978 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-512a08e4-c821-4a7b-9e5b-a21cc9b1ee41 req-463a507a-14f0-4249-8aaf-f29998e3afc8 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:42.394504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-512a08e4-c821-4a7b-9e5b-a21cc9b1ee41 req-463a507a-14f0-4249-8aaf-f29998e3afc8 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:42.406670 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-512a08e4-c821-4a7b-9e5b-a21cc9b1ee41 req-463a507a-14f0-4249-8aaf-f29998e3afc8 service nova] Creating event network-changed:ce2af983-4ada-48be-85de-0bb55d53e4c6 for instance 574b6476-5eeb-4eac-be78-7632db94cc3d on hv-cinder-85427 Aug 30 00:08:42.411434 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:42.412388 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-512a08e4-c821-4a7b-9e5b-a21cc9b1ee41 req-463a507a-14f0-4249-8aaf-f29998e3afc8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034202 Aug 30 00:08:42.412995 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 506/978] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:08:42.420006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0496c49e-c747-4aaa-a9f3-f770b8d8cada tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.212986 Aug 30 00:08:42.421511 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 473/979] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:42 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:42.953031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:42.953721 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:42.960512 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:42.969101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:42.969101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:42.969101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:42.969101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:42.969499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:43.094922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:43.102586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ce0d202e-7007-43fd-ab74-d714bd23a4e5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.154320 Aug 30 00:08:43.103203 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 507/980] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:42 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:43.441757 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:43.442499 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:43.448982 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:43.449465 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:43.449898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:43.450620 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:43.451074 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:43.451503 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:43.591003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:43.597219 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-aff43ff8-4919-4edb-b881-6649b5b4e103 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.159269 Aug 30 00:08:43.597945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 474/981] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:43 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:44.124261 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:44.124953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:44.132116 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:44.132606 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:44.133070 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:44.133779 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:44.134229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:44.134688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:44.264280 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:44.272606 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3bde08f4-e3d5-406d-9eea-a0286055f9c4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.152847 Aug 30 00:08:44.273156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 508/982] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:44 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:44.618405 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:44.619136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:44.625384 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:44.625871 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:44.626305 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:44.627022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:44.627473 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:44.627898 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:44.759121 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:44.767292 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b7f14640-3056-49b5-9d89-7b4567137b42 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.152814 Aug 30 00:08:44.767870 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 475/983] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:44 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:45.293040 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:45.293655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:45.300772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:45.301267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:45.301708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:45.302408 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:45.302894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:45.303322 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:45.437707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:45.445614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c585d39e-fd4a-4b21-9821-f3c8d76d8956 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.156448 Aug 30 00:08:45.446321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 509/984] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:45 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:45.778046 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-ac0f81bf-df2e-4261-8dfe-00df6e66a9e7 req-a0767ace-c54a-46b1-8d68-2f28aa073a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66588d83-f7ec-4bc5-9fc0-8d23544f2257", "name": "network-vif-plugged", "status": "completed", "tag": "76ab7d7b-499e-48f0-8a9f-7954b3e4a85a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:45.792674 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-ac0f81bf-df2e-4261-8dfe-00df6e66a9e7 req-a0767ace-c54a-46b1-8d68-2f28aa073a8f service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:45.792866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:45.793000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-ac0f81bf-df2e-4261-8dfe-00df6e66a9e7 req-a0767ace-c54a-46b1-8d68-2f28aa073a8f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:45.793118 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:45.793229 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-ac0f81bf-df2e-4261-8dfe-00df6e66a9e7 req-a0767ace-c54a-46b1-8d68-2f28aa073a8f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:45.794874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:45.795349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:45.796303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:45.796984 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:45.797427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:45.797876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:45.800924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-ac0f81bf-df2e-4261-8dfe-00df6e66a9e7 req-a0767ace-c54a-46b1-8d68-2f28aa073a8f service nova] Creating event network-vif-plugged:76ab7d7b-499e-48f0-8a9f-7954b3e4a85a for instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 on hv-cinder-85427 Aug 30 00:08:45.806038 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-ac0f81bf-df2e-4261-8dfe-00df6e66a9e7 req-a0767ace-c54a-46b1-8d68-2f28aa073a8f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031662 Aug 30 00:08:45.806672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 476/985] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:45.951944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:45.958099 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9f2b2773-790e-4d69-bb44-3d5b3e3d8b8c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.174143 Aug 30 00:08:45.958694 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 510/986] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:45 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:46.467905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:46.468620 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:46.474703 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:46.475239 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:46.475628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:46.476321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:46.476777 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:46.477233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:46.664947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:46.672548 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4039e0f9-c6dd-4362-a5ce-72bda82f92e3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1358 microversion: 2.1 time: 0.209583 Aug 30 00:08:46.674970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 477/987] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:46 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:46.979025 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:46.979666 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:46.986245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:46.987079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:46.987372 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:46.988120 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:46.988520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:46.988948 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:47.129054 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:47.137131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c4060c8c-98c9-4fc8-91c5-e657ef98b93b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.162234 Aug 30 00:08:47.137700 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 511/988] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:46 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:47.693111 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:47.694534 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:47.700019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:47.700513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:47.700945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:47.701646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:47.703000 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:47.703575 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:47.841148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:47.848745 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-253f2849-ab3f-4508-be92-bc251da47a74 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1549 microversion: 2.1 time: 0.159573 Aug 30 00:08:47.849315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 478/989] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:47 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:47.873184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:47.874311 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:47.880801 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:47.881541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:47.882032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:47.882763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:47.883226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:47.883772 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:48.016248 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:48.019991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=100 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:48.025649 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-16e889dc-ee1f-4dd9-b696-65622138b504 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1549 microversion: 2.1 time: 0.156238 Aug 30 00:08:48.029696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 512/990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:47 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:48.046412 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:48.052069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:48.053164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Searching by: {'deleted': False, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3'} {{(pid=127768) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 00:08:48.059968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:48.060519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:48.061084 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:48.061872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:48.062386 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:48.063076 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:48.154283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.multi_cell_list [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127768) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 00:08:48.167960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:48.168576 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:48.177954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:48.178592 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:48.178960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:48.179674 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:48.180139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:48.180560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:48.251584 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-443f06b2-2f65-437b-a16f-14bc1948ed4c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209506 Aug 30 00:08:48.252536 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 479/991] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Aug 30 00:08:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:48.265088 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:48.265631 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:48.271815 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:48.277999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:48.286557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:48.286557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:48.286557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:48.286557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:48.286958 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=100 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:48.327663 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:48.336028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e545b0b8-dd07-4a67-b066-da07c05ece86 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.172030 Aug 30 00:08:48.337749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 513/992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:48 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:48.453088 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:48.460980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-59bebdc7-21c5-4663-ac02-84d36d5a214c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1549 microversion: 2.1 time: 0.201250 Aug 30 00:08:48.461553 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 480/993] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:48 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:49.357539 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:49.358832 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:49.365405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:49.365885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:49.366313 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:49.367033 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:49.367485 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:49.367906 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:49.513537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:49.535473 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-179c4217-b0c8-45c0-a9e5-6af8d1665e61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.181957 Aug 30 00:08:49.536049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 514/994] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:49 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:50.560756 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:50.562558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:50.565614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98ada2b2-21ff-45de-94bc-2f1052799244"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:50.568094 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:50.569289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:50.575469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:50.575469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:50.575469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:50.575469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:50.575887 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:50.575981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:50.575981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:50.575981 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:50.576538 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:50.577662 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:50.577662 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:50.720164 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:50.728123 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1117de91-f2d0-45fe-886b-bce6cd47a9bb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.171686 Aug 30 00:08:50.728710 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 481/995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:50 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:51.290394 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1ef9b78b-72aa-4049-add1-adea177aea11 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729270 Aug 30 00:08:51.291203 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 515/996] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:08:50 2022] POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:08:51.717188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-116299999", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "networks": [{"uuid": "c53bd6ca-2079-47a8-899d-15021fc62eb0"}]}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:51.750272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:51.751011 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:51.757916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:51.758407 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:51.759060 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:51.759956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:51.760419 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:51.760844 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:51.911732 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:51.921491 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7edbc3b7-996f-4ea2-b063-e9803446bfad tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.175911 Aug 30 00:08:51.922306 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 516/997] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:51 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:51.927154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-9a5a5072-17ec-48a4-a40c-066e0f2c7dc9 req-fc1fe9e7-5ac3-4380-8e77-960b1f128b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574b6476-5eeb-4eac-be78-7632db94cc3d", "name": "network-vif-plugged", "status": "completed", "tag": "ce2af983-4ada-48be-85de-0bb55d53e4c6"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:51.937661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-9a5a5072-17ec-48a4-a40c-066e0f2c7dc9 req-fc1fe9e7-5ac3-4380-8e77-960b1f128b3e service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:51.938229 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-9a5a5072-17ec-48a4-a40c-066e0f2c7dc9 req-fc1fe9e7-5ac3-4380-8e77-960b1f128b3e service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:51.941146 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-9a5a5072-17ec-48a4-a40c-066e0f2c7dc9 req-fc1fe9e7-5ac3-4380-8e77-960b1f128b3e service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:51.951871 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-9a5a5072-17ec-48a4-a40c-066e0f2c7dc9 req-fc1fe9e7-5ac3-4380-8e77-960b1f128b3e service nova] Creating event network-vif-plugged:ce2af983-4ada-48be-85de-0bb55d53e4c6 for instance 574b6476-5eeb-4eac-be78-7632db94cc3d on hv-cinder-85427 Aug 30 00:08:51.954442 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] validate_networks() for [('c53bd6ca-2079-47a8-899d-15021fc62eb0', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:08:51.957299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-9a5a5072-17ec-48a4-a40c-066e0f2c7dc9 req-fc1fe9e7-5ac3-4380-8e77-960b1f128b3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Aug 30 00:08:51.958008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 517/998] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:52.309290 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:08:52.309706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:08:52.310170 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:08:52.310595 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:08:52.311030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:08:52.319792 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:52.320265 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:52.320689 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:52.321390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:52.321833 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:52.322244 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:52.339270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Getting quotas for project b1ec39b900ce4576980ee0f86b2cbf5e. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:08:52.344342 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Getting quotas for user f189a9c615b6456da780a1d3f0236002 and project b1ec39b900ce4576980ee0f86b2cbf5e. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:08:52.355763 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:08:52.358726 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:08:52.485905 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-68b61fb7-86ac-4fcc-8716-7550a1e501c0 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772591 Aug 30 00:08:52.486572 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 482/999] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:08:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:08:52.498808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-05c59e92-bac1-4c14-899d-028506d711af tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:52.499738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-05c59e92-bac1-4c14-899d-028506d711af tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:52.552514 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-05c59e92-bac1-4c14-899d-028506d711af tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:52.559623 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-05c59e92-bac1-4c14-899d-028506d711af tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1218 microversion: 2.1 time: 0.065630 Aug 30 00:08:52.560238 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 518/1000] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:52 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:52.942143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:52.942786 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:52.948924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:52.949405 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:52.949839 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:52.950554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:52.951007 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:52.951430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:53.086763 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:53.094443 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dc526a2f-fc87-4373-9b5a-c6a894e5e5bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1263 microversion: 2.1 time: 0.156576 Aug 30 00:08:53.095031 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 483/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:52 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:53.580384 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-620be59a-6ff0-4a26-bb84-e569562065bf tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:53.580937 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-620be59a-6ff0-4a26-bb84-e569562065bf tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:53.633885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-620be59a-6ff0-4a26-bb84-e569562065bf tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:53.641361 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-620be59a-6ff0-4a26-bb84-e569562065bf tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1218 microversion: 2.1 time: 0.065515 Aug 30 00:08:53.641930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 519/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:53 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:54.115699 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:54.116292 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:54.123361 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:54.123844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:54.124893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:54.125609 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:54.126044 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:54.126549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:54.256840 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:54.264639 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5ca449fb-dab2-456b-b9b2-25daec9b8822 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1450 microversion: 2.1 time: 0.152864 Aug 30 00:08:54.265204 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 484/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:54 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:08:54.285230 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:54.285840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:54.292043 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:54.292531 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:54.292969 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:54.293663 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:54.294121 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:54.294580 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:54.440852 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:54.443944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-cee0cde9-6ce7-4ddc-aa0f-4d34e268de78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1450 microversion: 2.1 time: 0.162672 Aug 30 00:08:54.444647 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 520/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:54 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:54.661646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:54.662251 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:54.668280 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:54.668770 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:54.669211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:54.669909 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:54.670361 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:54.671478 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:54.731654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:54.739918 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-442e75c0-7c09-4bd6-802b-35495818e4a6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1270 microversion: 2.1 time: 0.082139 Aug 30 00:08:54.740483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 485/1005] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:54 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:55.761389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:55.762106 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:55.769448 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:55.770008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:55.770455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:55.771170 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:55.771618 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:55.772035 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:56.001808 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:56.011264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-835871a0-f09d-4980-b815-779101c9964e tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1318 microversion: 2.1 time: 0.253822 Aug 30 00:08:56.013187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 521/1006] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:55 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:56.614462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-22f19ee0-eced-4210-975c-bf872bd6280f req-4ee84e02-fd21-48d0-8d59-3169c64c955a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2f287f-7701-4c1a-be80-f107c64b0f58", "tag": "be76968d-df55-4e6f-804d-ccf9e1b67f1a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:56.638430 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-22f19ee0-eced-4210-975c-bf872bd6280f req-4ee84e02-fd21-48d0-8d59-3169c64c955a service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:56.638932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-22f19ee0-eced-4210-975c-bf872bd6280f req-4ee84e02-fd21-48d0-8d59-3169c64c955a service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:56.639372 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-22f19ee0-eced-4210-975c-bf872bd6280f req-4ee84e02-fd21-48d0-8d59-3169c64c955a service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:56.651891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-22f19ee0-eced-4210-975c-bf872bd6280f req-4ee84e02-fd21-48d0-8d59-3169c64c955a service nova] Creating event network-changed:be76968d-df55-4e6f-804d-ccf9e1b67f1a for instance dc2f287f-7701-4c1a-be80-f107c64b0f58 on hv-cinder-85427 Aug 30 00:08:56.658711 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-22f19ee0-eced-4210-975c-bf872bd6280f req-4ee84e02-fd21-48d0-8d59-3169c64c955a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047628 Aug 30 00:08:56.659618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 486/1007] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:56.751283 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-01e2fa95-ab2b-4a26-ac8e-0468c3a6355c req-0e09e8f0-9a1c-4a94-9c05-c97755eab11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574b6476-5eeb-4eac-be78-7632db94cc3d", "tag": "ce2af983-4ada-48be-85de-0bb55d53e4c6"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:08:56.761770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-01e2fa95-ab2b-4a26-ac8e-0468c3a6355c req-0e09e8f0-9a1c-4a94-9c05-c97755eab11d service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:56.762959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-01e2fa95-ab2b-4a26-ac8e-0468c3a6355c req-0e09e8f0-9a1c-4a94-9c05-c97755eab11d service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:56.763445 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-01e2fa95-ab2b-4a26-ac8e-0468c3a6355c req-0e09e8f0-9a1c-4a94-9c05-c97755eab11d service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:56.774904 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-01e2fa95-ab2b-4a26-ac8e-0468c3a6355c req-0e09e8f0-9a1c-4a94-9c05-c97755eab11d service nova] Creating event network-changed:ce2af983-4ada-48be-85de-0bb55d53e4c6 for instance 574b6476-5eeb-4eac-be78-7632db94cc3d on hv-cinder-85427 Aug 30 00:08:56.779960 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-01e2fa95-ab2b-4a26-ac8e-0468c3a6355c req-0e09e8f0-9a1c-4a94-9c05-c97755eab11d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Aug 30 00:08:56.781769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 522/1008] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:08:57.036345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:57.037289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:57.044684 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:57.045516 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:57.046625 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:57.047589 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:57.048557 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:57.049079 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:57.261174 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:57.269268 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-f229d2c8-f0aa-435c-ae15-e0b2363e69a1 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1318 microversion: 2.1 time: 0.237657 Aug 30 00:08:57.269846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 487/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:57 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:58.290664 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:58.291311 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:58.293209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:58.298691 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:58.303151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:58.303151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:58.303151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:58.303151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:58.303509 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:58.433713 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:58.441359 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8167c86a-8d2d-409d-a1a2-6de94cfbdd71 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1318 microversion: 2.1 time: 0.155528 Aug 30 00:08:58.441928 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 523/1010] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:58 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:58.897740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:58.898347 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:58.900810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:58.906655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:58.907143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:58.907577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:58.908265 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:58.908719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:58.909140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:59.043311 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:59.051524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b5e13c63-9b06-454b-9069-a3fa51287ed6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1595 microversion: 2.1 time: 0.157492 Aug 30 00:08:59.052095 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 488/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:58 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:08:59.462409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:08:59.463278 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:08:59.470565 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:59.471125 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:59.471561 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:59.472250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:08:59.472696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:08:59.473116 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:08:59.683729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:08:59.690401 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9e0cd8b6-8614-46b0-a77d-5f1faaf94d04 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1318 microversion: 2.1 time: 0.232131 Aug 30 00:08:59.691087 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 524/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:08:59 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:00.710911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:00.711513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:00.718456 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:00.719211 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:00.719647 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:00.720322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:00.720767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:00.721178 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:00.851847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:00.859824 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fd275bda-fa7b-4012-93b5-31dd634e3667 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1318 microversion: 2.1 time: 0.152406 Aug 30 00:09:00.872324 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 489/1013] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:00 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:01.333665 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-29f55251-a09e-4fff-972b-4ba885b3089d req-96277b96-bbca-4c61-b481-6e1eb16f39c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66588d83-f7ec-4bc5-9fc0-8d23544f2257", "tag": "76ab7d7b-499e-48f0-8a9f-7954b3e4a85a"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:09:01.342438 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-29f55251-a09e-4fff-972b-4ba885b3089d req-96277b96-bbca-4c61-b481-6e1eb16f39c0 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:01.343105 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-29f55251-a09e-4fff-972b-4ba885b3089d req-96277b96-bbca-4c61-b481-6e1eb16f39c0 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:01.343831 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-29f55251-a09e-4fff-972b-4ba885b3089d req-96277b96-bbca-4c61-b481-6e1eb16f39c0 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:01.356471 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-29f55251-a09e-4fff-972b-4ba885b3089d req-96277b96-bbca-4c61-b481-6e1eb16f39c0 service nova] Creating event network-changed:76ab7d7b-499e-48f0-8a9f-7954b3e4a85a for instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 on hv-cinder-85427 Aug 30 00:09:01.362154 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-29f55251-a09e-4fff-972b-4ba885b3089d req-96277b96-bbca-4c61-b481-6e1eb16f39c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033587 Aug 30 00:09:01.362888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 525/1014] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:09:01.883057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:01.885020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:01.898192 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-2ee5d21e-f681-4750-a43f-2b25ff9a69e6 req-333d561b-b6b8-4cae-86d2-92666e557c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2f287f-7701-4c1a-be80-f107c64b0f58", "name": "network-vif-plugged", "status": "completed", "tag": "be76968d-df55-4e6f-804d-ccf9e1b67f1a"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:09:01.913033 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:01.917687 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:01.918259 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:01.919147 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:01.921733 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:01.923004 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:01.923865 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-2ee5d21e-f681-4750-a43f-2b25ff9a69e6 req-333d561b-b6b8-4cae-86d2-92666e557c64 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:01.926993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-2ee5d21e-f681-4750-a43f-2b25ff9a69e6 req-333d561b-b6b8-4cae-86d2-92666e557c64 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:01.927533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-2ee5d21e-f681-4750-a43f-2b25ff9a69e6 req-333d561b-b6b8-4cae-86d2-92666e557c64 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:01.944527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-2ee5d21e-f681-4750-a43f-2b25ff9a69e6 req-333d561b-b6b8-4cae-86d2-92666e557c64 service nova] Creating event network-vif-plugged:be76968d-df55-4e6f-804d-ccf9e1b67f1a for instance dc2f287f-7701-4c1a-be80-f107c64b0f58 on hv-cinder-85427 Aug 30 00:09:01.951247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-2ee5d21e-f681-4750-a43f-2b25ff9a69e6 req-333d561b-b6b8-4cae-86d2-92666e557c64 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063721 Aug 30 00:09:01.952823 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 526/1015] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:09:02.193111 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:02.201141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-e8ef2973-7bdf-40e7-8147-de8c2e1da70f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1318 microversion: 2.1 time: 0.324843 Aug 30 00:09:02.201719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 490/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:01 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:03.222795 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:03.223703 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:03.230389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:03.230896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:03.231325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:03.232012 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:03.232456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:03.232873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:03.371621 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:03.379939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-010e80bb-e2e7-411d-b5f0-5054d5d6e9e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1318 microversion: 2.1 time: 0.161906 Aug 30 00:09:03.386290 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 527/1017] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:03 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:04.208025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-939708153"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:09:04.208562 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:04.210371 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=4 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:04.211063 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=6 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:04.216296 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:04.216793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:04.217215 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:04.218498 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:04.218968 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:04.219429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:04.344722 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.network.security_group_api [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Adding security group e12a3a6f-d521-42f3-b88f-3decf5b72080 to port 76ab7d7b-499e-48f0-8a9f-7954b3e4a85a Aug 30 00:09:04.401381 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:04.402025 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:04.404065 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=4 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:04.409510 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:04.409994 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:04.410424 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:04.411142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:04.411590 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:04.412015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:04.551217 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:04.559482 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-514f0278-bcd7-46f1-8c72-4655640360b9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1507 microversion: 2.1 time: 0.161891 Aug 30 00:09:04.560276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 528/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:04 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:09:04.991668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-48c5e5c7-be77-4723-be12-708d426ff3a4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/action" status: 202 len: 0 microversion: 2.1 time: 0.787589 Aug 30 00:09:04.992618 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 491/1019] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:09:04 2022] POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:09:05.000303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-68f5b351-ef3b-4763-854d-35e42c57079b req-82f67520-470b-4826-9e84-e862ffd38b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66588d83-f7ec-4bc5-9fc0-8d23544f2257", "tag": "76ab7d7b-499e-48f0-8a9f-7954b3e4a85a"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:09:05.000915 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:05.001608 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:05.016250 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:05.016824 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:05.017337 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:05.026854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:05.027784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-68f5b351-ef3b-4763-854d-35e42c57079b req-82f67520-470b-4826-9e84-e862ffd38b84 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:05.027936 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:05.028281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-68f5b351-ef3b-4763-854d-35e42c57079b req-82f67520-470b-4826-9e84-e862ffd38b84 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:05.028724 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-68f5b351-ef3b-4763-854d-35e42c57079b req-82f67520-470b-4826-9e84-e862ffd38b84 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:05.028852 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:05.055299 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-68f5b351-ef3b-4763-854d-35e42c57079b req-82f67520-470b-4826-9e84-e862ffd38b84 service nova] Creating event network-changed:76ab7d7b-499e-48f0-8a9f-7954b3e4a85a for instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 on hv-cinder-85427 Aug 30 00:09:05.066044 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-68f5b351-ef3b-4763-854d-35e42c57079b req-82f67520-470b-4826-9e84-e862ffd38b84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070312 Aug 30 00:09:05.067244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 529/1020] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:09:05.278100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:05.290144 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bfa880e8-adb9-462e-9d16-775e1eca619e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1759 microversion: 2.1 time: 0.293044 Aug 30 00:09:05.291831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 492/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:04 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1759 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:09:21.136248 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=13 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:21.137030 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:21.141795 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6fe80b8-aadc-4354-aeb4-fa80bd6c12b8", "device": "/dev/sdb"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:09:21.144749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:21.150763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:21.151225 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:21.151658 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:21.152341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:21.152791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:21.153213 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:21.844378 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-60fd14ca-6c30-403a-94aa-b83177b48d53 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "POST /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709402 Aug 30 00:09:21.844990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 530/1022] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:09:21 2022] POST /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:09:34.445433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:09:34.447850 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:34.450058 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=9 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:34.450832 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=66 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:34.456036 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:34.456515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:34.456945 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:34.457658 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:34.458103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:34.458540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:34.701379 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c4dd9ae9-8249-4627-ac6d-3023be6d9321 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/action" status: 202 len: 0 microversion: 2.1 time: 0.259604 Aug 30 00:09:34.702094 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 493/1023] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:09:34 2022] POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:09:34.708904 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:34.709683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:34.713755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:34.714458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:34.721171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:34.721658 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:34.722102 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:34.722829 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:34.723344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:34.723771 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:34.992458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:35.001346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-aa4f5260-bacc-498d-8dd3-13ce06779224 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1751 microversion: 2.1 time: 0.294816 Aug 30 00:09:35.004926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 531/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:34 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1751 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:36.024842 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:36.034764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:36.034764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:36.034764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:36.034764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:36.035159 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:36.035159 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:36.035159 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:36.229758 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:36.238820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-58aef08e-0636-4202-a802-b327dc06d59d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1751 microversion: 2.1 time: 0.218647 Aug 30 00:09:36.239400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 494/1025] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:36 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:37.259876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:37.260417 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:37.266818 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:37.267305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:37.267749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:37.268442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:37.268896 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:37.269323 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:37.409311 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:37.417563 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-23fe7f8c-8218-4f54-9ec3-f8d504c817be tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1751 microversion: 2.1 time: 0.161946 Aug 30 00:09:37.418130 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 532/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:37 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:38.441191 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:38.441741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:38.449437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:38.449917 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:38.450348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:38.451066 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:38.451515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:38.451935 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:38.596117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:38.604276 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-65488983-0530-428d-a880-b2e2270aa4f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.167022 Aug 30 00:09:38.604846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 495/1027] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:38 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:39.625776 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:39.626405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:39.633026 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:39.633506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:39.633956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:39.634652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:39.635107 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:39.635530 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:39.778840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:39.786990 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5257a34c-40c0-428f-9336-60251b1163d2 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.165625 Aug 30 00:09:39.787562 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 533/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:39 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:40.808782 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:40.809368 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:40.816006 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:40.816483 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:40.817005 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:40.817691 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:40.818143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:40.818582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:40.958974 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:40.967015 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ca9b65c9-ac64-4a22-ac5d-188b2e2fab2e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.162213 Aug 30 00:09:40.967628 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 496/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:40 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:41.988917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:41.996502 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:41.996502 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:41.996502 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:41.996857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:41.997599 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:41.998052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:41.998487 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:42.144744 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:42.153140 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a6e21557-31e5-421e-8db1-93f54bbe15f3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.168166 Aug 30 00:09:42.159135 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 534/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:41 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:43.175028 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:43.175620 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:43.181904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:43.182373 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:43.182830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:43.183532 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:43.183979 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:43.184393 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:43.332795 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:43.340999 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a6c99419-0805-4def-b056-925d8f38b715 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.169810 Aug 30 00:09:43.342057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 497/1031] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:43 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:44.367365 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:44.368188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:44.375816 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:44.376384 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:44.376970 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:44.377814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:44.378499 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:44.378936 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:44.527089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:44.535309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4c7651e7-5b85-43de-be16-75aeaf423bb4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.172747 Aug 30 00:09:44.535864 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 535/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:44 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:45.557593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:45.558307 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:45.565456 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:45.565951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:45.566413 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:45.567146 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:45.567600 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:45.568023 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:45.712705 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:45.720948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-05364fbf-7678-4010-80f9-e109fb8e5df5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.167871 Aug 30 00:09:45.721513 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 498/1033] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:45 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:46.742333 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:46.742979 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:46.749501 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:46.749980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:46.750456 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:46.751131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:46.751586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:46.752044 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:46.793859 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:46.794432 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:46.800947 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:46.801432 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:46.801865 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:46.802594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:46.803045 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:46.803467 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:46.892775 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lazy-loading 'services' on Instance uuid dc2f287f-7701-4c1a-be80-f107c64b0f58 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:09:46.909347 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:46.917958 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f9ef64c2-f5db-446d-8e83-6567f444c56a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.179433 Aug 30 00:09:46.918674 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 536/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:46 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:47.140546 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8257d3bd-e8b3-494c-aa5d-6bbd93e5ed73 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58/os-volume_attachments/a6fe80b8-aadc-4354-aeb4-fa80bd6c12b8" status: 202 len: 0 microversion: 2.1 time: 0.350372 Aug 30 00:09:47.141182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 499/1035] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:09:46 2022] DELETE /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58/os-volume_attachments/a6fe80b8-aadc-4354-aeb4-fa80bd6c12b8 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:09:47.939041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:47.939571 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:47.945944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:47.946423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:47.946888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:47.947570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:47.948021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:47.948518 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:48.098267 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:48.106996 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-6dd01bb6-1c8a-43ab-bc72-62971a11799e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.171728 Aug 30 00:09:48.107624 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 537/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:47 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:48.268602 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:48.269213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:48.275308 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:48.278221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:48.278221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:48.278221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:48.278221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:48.279299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:48.303094 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:09:48.771403 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-24b6d036-cd7d-415b-9a29-a75997875023 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 204 len: 0 microversion: 2.1 time: 0.507148 Aug 30 00:09:48.772020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 500/1037] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:09:48 2022] DELETE /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:09:48.780372 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:48.781046 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:48.787089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:48.787560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:48.787997 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:48.788730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:48.789184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:48.789611 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:48.923617 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:48.931341 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-f2664a34-2c5a-43dc-9415-8a6d1dcaf6b7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1513 microversion: 2.1 time: 0.154957 Aug 30 00:09:48.931914 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 538/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:48 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:49.129583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:49.130201 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:49.136648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:49.137126 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:49.137554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:49.138322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:49.138801 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:49.139217 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:49.278167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:49.286913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-1aa30f77-c400-4515-bae0-a52481f4bff4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.161635 Aug 30 00:09:49.287491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 501/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:49 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:49.955574 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:49.956777 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:49.963477 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:49.963958 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:49.964391 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:49.965089 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:49.965569 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:49.965993 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:50.097393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:50.105108 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-dd2582f7-4a63-404a-a872-7ca105e375e9 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1513 microversion: 2.1 time: 0.155566 Aug 30 00:09:50.105673 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 539/1040] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:49 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:50.309596 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:50.310970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:50.317762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:50.318246 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:50.318712 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:50.319435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:50.319888 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:50.320315 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:50.466367 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:50.474649 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ca6318a3-0af4-43de-8700-2acc432141b7 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.169696 Aug 30 00:09:50.475218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 502/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:50 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:51.092942 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-487dc909-17ee-4e12-b439-53a763117b64 req-9fd5df8f-f5cc-4c8c-9258-01e87f3e1742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2f287f-7701-4c1a-be80-f107c64b0f58", "name": "network-vif-deleted", "tag": "be76968d-df55-4e6f-804d-ccf9e1b67f1a"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:09:51.102262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-487dc909-17ee-4e12-b439-53a763117b64 req-9fd5df8f-f5cc-4c8c-9258-01e87f3e1742 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:51.102764 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-487dc909-17ee-4e12-b439-53a763117b64 req-9fd5df8f-f5cc-4c8c-9258-01e87f3e1742 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:51.103246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-487dc909-17ee-4e12-b439-53a763117b64 req-9fd5df8f-f5cc-4c8c-9258-01e87f3e1742 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:51.114102 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-487dc909-17ee-4e12-b439-53a763117b64 req-9fd5df8f-f5cc-4c8c-9258-01e87f3e1742 service nova] Creating event network-vif-deleted:be76968d-df55-4e6f-804d-ccf9e1b67f1a for instance dc2f287f-7701-4c1a-be80-f107c64b0f58 on hv-cinder-85427 Aug 30 00:09:51.119144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-487dc909-17ee-4e12-b439-53a763117b64 req-9fd5df8f-f5cc-4c8c-9258-01e87f3e1742 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 Aug 30 00:09:51.119729 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 540/1042] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:09:51.126549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:51.127202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:51.133750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:51.134232 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:51.134739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:51.135435 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:51.135891 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:51.136317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:51.206591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:51.215055 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-49d847d1-7472-489c-9da2-823103c39164 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1471 microversion: 2.1 time: 0.093669 Aug 30 00:09:51.215872 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 503/1043] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:51 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:09:51.496712 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:51.497933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:51.504211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:51.504692 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:51.505158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:51.506105 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:51.506586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:51.507018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:51.654156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:51.669409 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-adfc32b9-fe48-4ba9-bcc4-722cac24980a tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.177140 Aug 30 00:09:51.670031 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 541/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:51 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:52.237539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:52.238202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:52.244626 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:52.245106 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:52.245543 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:52.246230 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:52.246713 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:52.247199 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:52.278175 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:52.279233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:52.279672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:52.280118 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lazy-loading 'fault' on Instance uuid dc2f287f-7701-4c1a-be80-f107c64b0f58 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:09:52.320725 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:52.327925 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5492df89-90cb-4b90-b6f6-a19cb9114586 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 200 len: 1308 microversion: 2.1 time: 0.094314 Aug 30 00:09:52.328760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 504/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:52 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:52.694204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:52.694827 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:52.701791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:52.706045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:52.706045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:52.706045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:52.706045 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:52.706439 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:52.843706 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:52.852018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-263e9cf6-5773-4d88-b1b1-f2bcb20647b6 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.161722 Aug 30 00:09:52.852584 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 542/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:52 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:53.351722 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:53.352643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: dc2f287f-7701-4c1a-be80-f107c64b0f58] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:53.359694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:53.360177 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:53.360615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:53.361309 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:53.361762 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:53.362190 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:53.376390 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] HTTP exception thrown: Instance dc2f287f-7701-4c1a-be80-f107c64b0f58 could not be found. Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Request method failure captured: Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 HTTP/1.1 Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVURR7MyAAyF6Mh49d23MlTYs7sd1DpZVjQiQ-rzjolLbLyrTaEl0hm6Jw5EdFvr4tVzysYcNV_JPZBI9ySehfkmwR2zWRvAvALt25iVdhc7hgz7oAm69SVdNbfq86lRb7V82Fo-Fo1UTXqBZ6aPAEyp_nNuRGNChXdttS7wMELOF04 Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: b1ec39b900ce4576980ee0f86b2cbf5e Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1790642131 Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:09:53.378817 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b1ec39b900ce4576980ee0f86b2cbf5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b1ec39b900ce4576980ee0f86b2cbf5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1ec39b900ce4576980ee0f86b2cbf5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1ec39b900ce4576980ee0f86b2cbf5e"}]}] Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-VolumesSnapshotTestJSON-1790642131 Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: b1ec39b900ce4576980ee0f86b2cbf5e Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1790642131 Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-VolumesSnapshotTestJSON-1790642131-project Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: f189a9c615b6456da780a1d3f0236002 Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-VolumesSnapshotTestJSON-1790642131-project Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance dc2f287f-7701-4c1a-be80-f107c64b0f58 could not be found. Aug 30 00:09:53.380686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': 'dc2f287f-7701-4c1a-be80-f107c64b0f58'} Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2f287f-7701-4c1a-be80-f107c64b0f58 could not be found. Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:09:53.381558 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2f287f-7701-4c1a-be80-f107c64b0f58 could not be found. Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2f287f-7701-4c1a-be80-f107c64b0f58 could not be found. Aug 30 00:09:53.383223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:09:53.384619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Returning 404 to user: Instance dc2f287f-7701-4c1a-be80-f107c64b0f58 could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:09:53.384619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fa9bc00d-395d-4e34-be7b-977bef9def79 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58" status: 404 len: 111 microversion: 2.1 time: 0.034872 Aug 30 00:09:53.384619 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 505/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:53 2022] GET /compute/v2.1/servers/dc2f287f-7701-4c1a-be80-f107c64b0f58 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:09:53.872200 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:53.872813 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:53.879256 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:53.879735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:53.880216 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:53.881116 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:53.881573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:53.882003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:54.025814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:54.034123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8c0e01dc-ab58-49d8-b44f-6af49dcc41da tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1756 microversion: 2.1 time: 0.165797 Aug 30 00:09:54.034708 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 543/1048] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:53 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:09:55.055793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:09:55.056433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:09:55.062973 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:55.063448 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:55.063881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:55.064599 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:09:55.065056 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:09:55.065481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:09:55.083771 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:55.204520 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:09:55.212461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-06c5a43f-6ba2-46a1-8f83-0ce2f8af48cd tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1759 microversion: 2.1 time: 0.160568 Aug 30 00:09:55.213021 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 506/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:09:55 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:03.000249 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2037399297", "imageRef": "3607060b-f594-41b9-9ba8-755fe29c8140", "flavorRef": "452", "networks": [{"uuid": "c53bd6ca-2079-47a8-899d-15021fc62eb0"}]}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:03.060589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] validate_networks() for [('c53bd6ca-2079-47a8-899d-15021fc62eb0', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:10:03.432144 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:10:03.432569 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:10:03.433036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:10:03.433447 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:10:03.433858 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:10:03.442915 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:03.443327 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:03.443767 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:03.444489 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:03.444935 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:03.445355 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:03.463763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Getting quotas for project b1ec39b900ce4576980ee0f86b2cbf5e. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:10:03.468360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Getting quotas for user f189a9c615b6456da780a1d3f0236002 and project b1ec39b900ce4576980ee0f86b2cbf5e. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:10:03.479465 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:10:03.482356 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3607060b-f594-41b9-9ba8-755fe29c8140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:10:03.633246 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-29c00a5a-0547-43d1-af58-1333c6107785 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637401 Aug 30 00:10:03.633901 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 544/1050] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:10:03.644982 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4afd6c78-bce0-40b0-a3f3-c6e77614e118 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:03.645624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4afd6c78-bce0-40b0-a3f3-c6e77614e118 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:03.704597 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4afd6c78-bce0-40b0-a3f3-c6e77614e118 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:03.711431 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4afd6c78-bce0-40b0-a3f3-c6e77614e118 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1219 microversion: 2.1 time: 0.070533 Aug 30 00:10:03.715077 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 507/1051] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:03 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:04.733505 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:04.734156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:04.740290 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:04.740770 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:04.741202 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:04.741888 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:04.742340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:04.742800 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:04.829076 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:04.836985 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7eeb1c33-af3e-445d-a31c-b2acf7229a3a tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1223 microversion: 2.1 time: 0.108351 Aug 30 00:10:04.837556 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 545/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:04 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:05.857426 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:05.858064 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:05.860394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:05.861060 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:05.866015 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:05.866566 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:05.867002 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:05.867723 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:05.868171 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:05.868592 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:05.931110 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:05.939299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-283ab3ca-0053-43fe-98d7-f368c3cc739b tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1271 microversion: 2.1 time: 0.085816 Aug 30 00:10:05.939873 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 508/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:05 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:06.960857 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:06.961589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:06.963939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:06.969403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:06.969737 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:06.970196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:06.970984 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:06.971444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:06.973064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:06.975824 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=83 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:07.112659 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:07.124792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e21ac0f9-a60c-467b-b10e-587ab580f5ac tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1319 microversion: 2.1 time: 0.167669 Aug 30 00:10:07.126184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 546/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:06 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:07.853582 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-bf80fbe1-9f0f-46a9-8e6a-1b52da222cc0 req-3dde85f3-dcc1-43b8-af99-b76b66ebaf53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f115ec80-7d96-4386-afa4-36d6ee36c6c3", "tag": "33d9e16b-839a-4e0c-82fb-ea7820fdefbd"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:07.866574 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-bf80fbe1-9f0f-46a9-8e6a-1b52da222cc0 req-3dde85f3-dcc1-43b8-af99-b76b66ebaf53 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:07.867084 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-bf80fbe1-9f0f-46a9-8e6a-1b52da222cc0 req-3dde85f3-dcc1-43b8-af99-b76b66ebaf53 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:07.867511 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-bf80fbe1-9f0f-46a9-8e6a-1b52da222cc0 req-3dde85f3-dcc1-43b8-af99-b76b66ebaf53 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:07.879980 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-bf80fbe1-9f0f-46a9-8e6a-1b52da222cc0 req-3dde85f3-dcc1-43b8-af99-b76b66ebaf53 service nova] Creating event network-changed:33d9e16b-839a-4e0c-82fb-ea7820fdefbd for instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 on hv-cinder-85427 Aug 30 00:10:07.885868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-bf80fbe1-9f0f-46a9-8e6a-1b52da222cc0 req-3dde85f3-dcc1-43b8-af99-b76b66ebaf53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036060 Aug 30 00:10:07.886554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 509/1055] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:10:08.151514 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:08.152090 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:08.161756 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:08.162185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:08.163224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:08.163507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:08.163944 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:08.164364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:08.295910 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:08.304019 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7555abf7-e9d8-455d-9d09-fc7b48583549 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1319 microversion: 2.1 time: 0.157222 Aug 30 00:10:08.304593 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 547/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:08 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:09.325144 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:09.325820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:09.332729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:09.333212 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:09.333648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:09.334340 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:09.334910 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:09.335327 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:09.464012 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:09.472419 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4bc4cf8f-414d-4da9-a2d6-d0bc6cf49107 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1319 microversion: 2.1 time: 0.151736 Aug 30 00:10:09.472990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 510/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:09 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:10.493572 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:10.494211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:10.500705 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:10.508802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:10.508802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:10.508802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:10.508802 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:10.509369 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:10.638876 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:10.646769 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-df9edaa1-7761-4b82-8f59-70216067d654 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1319 microversion: 2.1 time: 0.157272 Aug 30 00:10:10.647337 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 548/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:10 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:11.668015 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:11.668652 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:11.675320 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:11.675803 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:11.676254 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:11.676931 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:11.677425 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:11.677846 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:11.812956 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:11.820578 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-bb07b355-d78f-4919-a6f3-abfbb705b1bb tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1319 microversion: 2.1 time: 0.156809 Aug 30 00:10:11.821141 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 511/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:11 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:12.395332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-3b4b9d62-4785-4600-9d8f-1ae90903c189 req-9db245ef-e895-4cdd-b0af-94e332aa0e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f115ec80-7d96-4386-afa4-36d6ee36c6c3", "name": "network-vif-plugged", "status": "completed", "tag": "33d9e16b-839a-4e0c-82fb-ea7820fdefbd"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:12.407717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-3b4b9d62-4785-4600-9d8f-1ae90903c189 req-9db245ef-e895-4cdd-b0af-94e332aa0e20 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:12.407717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-3b4b9d62-4785-4600-9d8f-1ae90903c189 req-9db245ef-e895-4cdd-b0af-94e332aa0e20 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:12.407717 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-3b4b9d62-4785-4600-9d8f-1ae90903c189 req-9db245ef-e895-4cdd-b0af-94e332aa0e20 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:12.420521 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-3b4b9d62-4785-4600-9d8f-1ae90903c189 req-9db245ef-e895-4cdd-b0af-94e332aa0e20 service nova] Creating event network-vif-plugged:33d9e16b-839a-4e0c-82fb-ea7820fdefbd for instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 on hv-cinder-85427 Aug 30 00:10:12.425414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-3b4b9d62-4785-4600-9d8f-1ae90903c189 req-9db245ef-e895-4cdd-b0af-94e332aa0e20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033897 Aug 30 00:10:12.426000 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 549/1060] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:10:12.841916 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:12.842600 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:12.848981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:12.849461 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:12.849894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:12.850654 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:12.851163 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:12.856585 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:12.984300 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:12.992225 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-87e10a04-5fae-43d8-bf81-8e4abceb908f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1319 microversion: 2.1 time: 0.154456 Aug 30 00:10:13.008651 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 512/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:12 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:14.012309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:14.013008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=6 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:14.017675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:14.018385 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:14.024565 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:14.025049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:14.025486 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:14.026180 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:14.026663 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:14.027167 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:14.156211 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:14.164534 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b7cc87a8-b2bf-4924-a9b7-aad2b31e1a1f tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1319 microversion: 2.1 time: 0.154622 Aug 30 00:10:14.168783 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 550/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:14 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:15.185046 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:15.185663 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:15.187753 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:15.193047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:15.193530 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:15.193966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:15.194692 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:15.195143 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:15.195593 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:15.321880 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:15.330136 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-62b79c94-9b06-41cd-9eca-56f227142ec2 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1508 microversion: 2.1 time: 0.149054 Aug 30 00:10:15.338179 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 513/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:15 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:15.351188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9d8e8be-4107-4bb1-b3fc-6a4d2b91271c", "device": "/dev/sdb"}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:15.353609 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:15.360749 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:15.361241 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:15.361727 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:15.362423 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:15.362933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:15.363359 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:16.404722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1876398e-ff6a-4bfc-8a91-bfeac074fc97 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "POST /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.057378 Aug 30 00:10:16.405464 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 551/1064] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 30 00:10:15 2022] POST /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3/os-volume_attachments => generated 194 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:10:28.479438 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-939708153"}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:28.480001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:28.486168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=11 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:28.486168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=32 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:28.488102 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:28.488594 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:28.489003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:28.489678 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:28.490119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:28.490556 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:28.628072 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.network.security_group_api [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Removing security group e12a3a6f-d521-42f3-b88f-3decf5b72080 from port 76ab7d7b-499e-48f0-8a9f-7954b3e4a85a Aug 30 00:10:29.345468 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fc96d3c4-6359-4a41-bc6c-5087011437b4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/action" status: 202 len: 0 microversion: 2.1 time: 0.869827 Aug 30 00:10:29.346091 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 514/1065] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 30 00:10:28 2022] POST /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/action => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:10:29.362303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=11 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:29.363735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:29.426952 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-2434a0d4-d856-4914-b435-f729b86370d4 req-37103c61-91d4-4f46-bdcf-9789a9a5f4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66588d83-f7ec-4bc5-9fc0-8d23544f2257", "tag": "76ab7d7b-499e-48f0-8a9f-7954b3e4a85a"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:29.436972 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-2434a0d4-d856-4914-b435-f729b86370d4 req-37103c61-91d4-4f46-bdcf-9789a9a5f4a0 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:29.437458 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-2434a0d4-d856-4914-b435-f729b86370d4 req-37103c61-91d4-4f46-bdcf-9789a9a5f4a0 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:29.437892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-2434a0d4-d856-4914-b435-f729b86370d4 req-37103c61-91d4-4f46-bdcf-9789a9a5f4a0 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:29.450488 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-2434a0d4-d856-4914-b435-f729b86370d4 req-37103c61-91d4-4f46-bdcf-9789a9a5f4a0 service nova] Creating event network-changed:76ab7d7b-499e-48f0-8a9f-7954b3e4a85a for instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 on hv-cinder-85427 Aug 30 00:10:29.455676 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-2434a0d4-d856-4914-b435-f729b86370d4 req-37103c61-91d4-4f46-bdcf-9789a9a5f4a0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099939 Aug 30 00:10:29.456276 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 552/1066] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:10:30.529951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:30.530494 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:30.536540 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:30.537029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:30.537496 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:30.538167 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:30.538779 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:30.539208 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:30.624422 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lazy-loading 'services' on Instance uuid 66588d83-f7ec-4bc5-9fc0-8d23544f2257 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:10:31.073784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-90096e0f-d638-4965-ad28-b3d0d311d34e tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments/98ada2b2-21ff-45de-94bc-2f1052799244" status: 202 len: 0 microversion: 2.1 time: 0.548049 Aug 30 00:10:31.074701 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 515/1067] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:10:30 2022] DELETE /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments/98ada2b2-21ff-45de-94bc-2f1052799244 => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:10:31.084513 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:31.086973 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:31.093555 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:31.094036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:31.094506 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:31.095682 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:31.096325 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:31.097787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:31.129032 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7274bcb8-4ff9-414d-9905-a07e1c7696f8 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049900 Aug 30 00:10:31.129603 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 553/1068] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:10:31 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:10:31.471336 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-9ece203c-e8ca-449b-9f6d-700b9f5f2ba9 req-0e2cff6f-97f3-4a85-a266-b4d81d2ab5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66588d83-f7ec-4bc5-9fc0-8d23544f2257", "tag": "76ab7d7b-499e-48f0-8a9f-7954b3e4a85a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:31.480668 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9ece203c-e8ca-449b-9f6d-700b9f5f2ba9 req-0e2cff6f-97f3-4a85-a266-b4d81d2ab5da service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:31.481787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9ece203c-e8ca-449b-9f6d-700b9f5f2ba9 req-0e2cff6f-97f3-4a85-a266-b4d81d2ab5da service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:31.481787 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-9ece203c-e8ca-449b-9f6d-700b9f5f2ba9 req-0e2cff6f-97f3-4a85-a266-b4d81d2ab5da service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:31.492133 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-9ece203c-e8ca-449b-9f6d-700b9f5f2ba9 req-0e2cff6f-97f3-4a85-a266-b4d81d2ab5da service nova] Creating event network-changed:76ab7d7b-499e-48f0-8a9f-7954b3e4a85a for instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 on hv-cinder-85427 Aug 30 00:10:31.496911 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-9ece203c-e8ca-449b-9f6d-700b9f5f2ba9 req-0e2cff6f-97f3-4a85-a266-b4d81d2ab5da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030266 Aug 30 00:10:31.497473 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 516/1069] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:10:32.142722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:32.144991 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:32.171037 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:32.174232 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:32.174557 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:32.175264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:32.181987 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:32.181987 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:32.222992 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-3bd63a81-715c-4bf4-9216-546e5056d656 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084898 Aug 30 00:10:32.224266 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 554/1070] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:10:32 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:10:33.236845 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:33.239162 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:33.246729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:33.253099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:33.253099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:33.253099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:33.253099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:33.253622 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:33.279236 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-740d0fec-a4e4-426b-9be2-466267bab7b5 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047248 Aug 30 00:10:33.279834 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 517/1071] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:10:33 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:10:34.292668 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:34.294701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:34.301752 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:34.302236 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:34.302698 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:34.303393 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:34.303844 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:34.304264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:34.333938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-9a4be072-5f27-4597-8989-0ab66ccd5524 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045515 Aug 30 00:10:34.334532 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 555/1072] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 30 00:10:34 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:10:34.345805 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:34.346298 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:34.353228 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:34.353710 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:34.354145 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:34.354875 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:34.355330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:34.355754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:34.431735 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] HTTP exception thrown: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 is not attached to volume 98ada2b2-21ff-45de-94bc-2f1052799244 Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Request method failure captured: Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments/98ada2b2-21ff-45de-94bc-2f1052799244 HTTP/1.1 Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVTnN1LM-E2ATdF9Wj-hoQLqy6W45v0ElcLS51QFzU517935kG5cwkFIVgbwiFLQ6DyWpw3aXKVUaTvIzPNZBHUd_oz8V5z2SFUWQgDA5w2JrO3iS71FEnt6sVWNlecUbKsIqw572JvAyLJLQOWNBqMjCZFG9MDSq2ELS6SaCWTW-NU Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: b8de2818d269420b84f3fb8a18781ed3 Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-TestMinimumBasicScenario-1879497997 Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:10:34.434181 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b8de2818d269420b84f3fb8a18781ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b8de2818d269420b84f3fb8a18781ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b8de2818d269420b84f3fb8a18781ed3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b8de2818d269420b84f3fb8a18781ed3"}]}] Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-TestMinimumBasicScenario-1879497997 Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: b8de2818d269420b84f3fb8a18781ed3 Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1879497997 Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-TestMinimumBasicScenario-1879497997-project Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: 8e07e41fba924b8d9ddc6878f2aefb8c Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-TestMinimumBasicScenario-1879497997-project Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:10:34.436019 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 is not attached to volume 98ada2b2-21ff-45de-94bc-2f1052799244 Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'server_id': '66588d83-f7ec-4bc5-9fc0-8d23544f2257', 'id': '98ada2b2-21ff-45de-94bc-2f1052799244'} Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 98ada2b2-21ff-45de-94bc-2f1052799244. Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:10:34.436904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 is not attached to volume 98ada2b2-21ff-45de-94bc-2f1052799244 Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 is not attached to volume 98ada2b2-21ff-45de-94bc-2f1052799244 Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:10:34.438512 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Returning 404 to user: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 is not attached to volume 98ada2b2-21ff-45de-94bc-2f1052799244 {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:10:34.439783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d2618477-e92c-481d-bcae-9fc7f2b8be1c tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments/98ada2b2-21ff-45de-94bc-2f1052799244" status: 404 len: 154 microversion: 2.1 time: 0.094487 Aug 30 00:10:34.439783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 518/1073] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:10:34 2022] DELETE /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257/os-volume_attachments/98ada2b2-21ff-45de-94bc-2f1052799244 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:10:35.814188 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:35.814801 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:35.821242 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:35.821720 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:35.822149 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:35.822874 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:35.823321 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:35.823739 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:35.855209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:10:36.482254 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-06bb5578-de7c-4926-b859-8359eae7063f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "DELETE /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 204 len: 0 microversion: 2.1 time: 0.671687 Aug 30 00:10:36.482886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 556/1074] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:10:35 2022] DELETE /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:10:36.491214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:36.491822 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:36.498283 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:36.498805 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:36.499233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:36.499921 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:36.500371 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:36.500791 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:36.643519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:36.651237 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-17f409b5-cc6a-41c2-9f57-3d75c3208214 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1555 microversion: 2.1 time: 0.163969 Aug 30 00:10:36.651802 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 519/1075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:36 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:36.946924 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:36.947505 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:36.953819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:36.954296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:36.954765 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:36.955447 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:36.955902 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:36.956320 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:37.040860 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lazy-loading 'services' on Instance uuid f115ec80-7d96-4386-afa4-36d6ee36c6c3 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:10:37.389918 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b3210f79-0874-4cae-a1ee-6ee0dcbb1181 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3/os-volume_attachments/d9d8e8be-4107-4bb1-b3fc-6a4d2b91271c" status: 202 len: 0 microversion: 2.1 time: 0.447191 Aug 30 00:10:37.390538 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 557/1076] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 30 00:10:36 2022] DELETE /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3/os-volume_attachments/d9d8e8be-4107-4bb1-b3fc-6a4d2b91271c => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:10:37.672924 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:37.673481 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:37.679983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:37.680460 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:37.680894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:37.681583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:37.682030 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:37.682447 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:37.809213 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:37.817491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2de33da2-d653-49cd-a253-11bb5e8813b3 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1555 microversion: 2.1 time: 0.148623 Aug 30 00:10:37.818057 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 520/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:37 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:38.841026 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:38.841725 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:38.850077 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:38.852890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:38.852890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:38.852890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:38.852890 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:38.853312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:39.017817 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:39.025917 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7a215f58-bb35-4967-b712-a1b20895868f tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1555 microversion: 2.1 time: 0.190739 Aug 30 00:10:39.026519 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 558/1078] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:38 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:39.166739 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-3151c9a7-d8d1-456c-8105-498c589dddbe req-b89fa9f3-7bc0-4b08-93a5-91a5d063daac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66588d83-f7ec-4bc5-9fc0-8d23544f2257", "name": "network-vif-deleted", "tag": "76ab7d7b-499e-48f0-8a9f-7954b3e4a85a"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:39.175843 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-3151c9a7-d8d1-456c-8105-498c589dddbe req-b89fa9f3-7bc0-4b08-93a5-91a5d063daac service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:39.176333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-3151c9a7-d8d1-456c-8105-498c589dddbe req-b89fa9f3-7bc0-4b08-93a5-91a5d063daac service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:39.176767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-3151c9a7-d8d1-456c-8105-498c589dddbe req-b89fa9f3-7bc0-4b08-93a5-91a5d063daac service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:39.187948 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-3151c9a7-d8d1-456c-8105-498c589dddbe req-b89fa9f3-7bc0-4b08-93a5-91a5d063daac service nova] Creating event network-vif-deleted:76ab7d7b-499e-48f0-8a9f-7954b3e4a85a for instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 on hv-cinder-85427 Aug 30 00:10:39.193634 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-3151c9a7-d8d1-456c-8105-498c589dddbe req-b89fa9f3-7bc0-4b08-93a5-91a5d063daac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Aug 30 00:10:39.194149 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 521/1079] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:10:39.590979 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:39.591483 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:39.603678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:39.603678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:39.603678 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:39.604324 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:39.604980 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:39.605461 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:39.635365 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:10:40.048437 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:40.049130 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:40.055661 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:40.056177 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:40.056614 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:40.057317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:40.057775 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:40.058202 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:40.090856 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:40.091298 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:40.091793 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:40.092188 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lazy-loading 'fault' on Instance uuid 66588d83-f7ec-4bc5-9fc0-8d23544f2257 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:10:40.135671 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:40.144022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-10a720da-014d-48d7-b41b-f50116bebbdb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1348 microversion: 2.1 time: 0.099948 Aug 30 00:10:40.144601 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 522/1080] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:40 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:10:40.173947 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-51387d62-2616-4c5f-93b6-c16b24bc5b6d tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 204 len: 0 microversion: 2.1 time: 0.588366 Aug 30 00:10:40.174633 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 559/1081] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:10:39 2022] DELETE /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:10:40.191510 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:40.192747 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:40.201799 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:40.202585 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:40.203299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:40.204774 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:40.205355 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:40.205838 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:40.381382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:40.381382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-528a333d-f77b-45ef-a831-b8b1ee24e212 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1514 microversion: 2.1 time: 0.168648 Aug 30 00:10:40.381382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 523/1082] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:40 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:41.165207 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:41.165904 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:41.172257 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:41.173361 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:41.173791 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:41.174527 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:41.175185 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:41.175507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:41.207613 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:41.208130 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:41.208537 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:41.208988 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lazy-loading 'fault' on Instance uuid 66588d83-f7ec-4bc5-9fc0-8d23544f2257 {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:10:41.251696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e07e41fba924b8d9ddc6878f2aefb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8de2818d269420b84f3fb8a18781ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:41.259774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-980c00b6-fbf5-4fcb-8f78-6bb5a95f42eb tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 200 len: 1348 microversion: 2.1 time: 0.098997 Aug 30 00:10:41.261523 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 560/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:41 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:41.377265 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:41.377879 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:41.384971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:41.385458 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:41.385886 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:41.386648 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:41.387099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:41.387704 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:41.525571 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:41.535095 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fcac264b-0180-4dcc-840f-a7031b7dd5f7 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1514 microversion: 2.1 time: 0.161675 Aug 30 00:10:41.535970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 524/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:41 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:42.281816 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:42.283063 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] [instance: 66588d83-f7ec-4bc5-9fc0-8d23544f2257] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:42.289595 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:42.290079 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:42.290582 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:42.291289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:42.291760 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:42.292163 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:42.307655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] HTTP exception thrown: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 could not be found. Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Request method failure captured: Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 HTTP/1.1 Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVTnN1LM-E2ATdF9Wj-hoQLqy6W45v0ElcLS51QFzU517935kG5cwkFIVgbwiFLQ6DyWpw3aXKVUaTvIzPNZBHUd_oz8V5z2SFUWQgDA5w2JrO3iS71FEnt6sVWNlecUbKsIqw572JvAyLJLQOWNBqMjCZFG9MDSq2ELS6SaCWTW-NU Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: b8de2818d269420b84f3fb8a18781ed3 Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-TestMinimumBasicScenario-1879497997 Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:10:42.308429 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b8de2818d269420b84f3fb8a18781ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b8de2818d269420b84f3fb8a18781ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b8de2818d269420b84f3fb8a18781ed3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b8de2818d269420b84f3fb8a18781ed3"}]}] Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-TestMinimumBasicScenario-1879497997 Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: b8de2818d269420b84f3fb8a18781ed3 Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1879497997 Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-TestMinimumBasicScenario-1879497997-project Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: 8e07e41fba924b8d9ddc6878f2aefb8c Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-TestMinimumBasicScenario-1879497997-project Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 could not be found. Aug 30 00:10:42.309792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '66588d83-f7ec-4bc5-9fc0-8d23544f2257'} Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 could not be found. Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:10:42.310730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 could not be found. Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 could not be found. Aug 30 00:10:42.312036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:42.313209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Returning 404 to user: Instance 66588d83-f7ec-4bc5-9fc0-8d23544f2257 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:10:42.313209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-01347593-62b9-4397-84fd-b98690994da4 tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257" status: 404 len: 111 microversion: 2.1 time: 0.031943 Aug 30 00:10:42.313209 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 561/1085] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:42 2022] GET /compute/v2.1/servers/66588d83-f7ec-4bc5-9fc0-8d23544f2257 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:10:42.320302 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-94b8733d-4c51-4ea9-9881-6c788c24038d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] Calling method '.version_select at 0x7f09bf257310>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:42.455545 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-006dc884-7c12-4a9d-b78d-fd323ab9fad3 req-8561804a-b0f2-4cdb-aa45-d6d0fe9eaf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f115ec80-7d96-4386-afa4-36d6ee36c6c3", "name": "network-vif-deleted", "tag": "33d9e16b-839a-4e0c-82fb-ea7820fdefbd"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:10:42.465128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-006dc884-7c12-4a9d-b78d-fd323ab9fad3 req-8561804a-b0f2-4cdb-aa45-d6d0fe9eaf0e service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:42.467360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-006dc884-7c12-4a9d-b78d-fd323ab9fad3 req-8561804a-b0f2-4cdb-aa45-d6d0fe9eaf0e service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:42.467360 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-006dc884-7c12-4a9d-b78d-fd323ab9fad3 req-8561804a-b0f2-4cdb-aa45-d6d0fe9eaf0e service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:42.479196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-006dc884-7c12-4a9d-b78d-fd323ab9fad3 req-8561804a-b0f2-4cdb-aa45-d6d0fe9eaf0e service nova] Creating event network-vif-deleted:33d9e16b-839a-4e0c-82fb-ea7820fdefbd for instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 on hv-cinder-85427 Aug 30 00:10:42.484106 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-006dc884-7c12-4a9d-b78d-fd323ab9fad3 req-8561804a-b0f2-4cdb-aa45-d6d0fe9eaf0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032255 Aug 30 00:10:42.484688 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 562/1086] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:10:42.556599 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:42.557307 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:42.563741 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:42.564226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:42.564656 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:42.565344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:42.565793 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:42.566210 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:42.574767 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-94b8733d-4c51-4ea9-9881-6c788c24038d tempest-TestMinimumBasicScenario-1879497997 tempest-TestMinimumBasicScenario-1879497997-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-189467714" status: 202 len: 0 microversion: 2.1 time: 0.259942 Aug 30 00:10:42.578624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 525/1087] 10.222.0.60 () {58 vars in 1269 bytes} [Tue Aug 30 00:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-189467714 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:10:42.639366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:42.648540 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-13cb3ca3-6299-4a42-a0c9-4e09b1369bf4 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1472 microversion: 2.1 time: 0.096115 Aug 30 00:10:42.649153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 563/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:42 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1472 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:10:43.674862 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:43.675479 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:43.682289 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:43.682810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:43.683282 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:43.683981 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:43.684485 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:43.684847 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:43.717990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:43.717990 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:43.718339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:43.719003 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lazy-loading 'fault' on Instance uuid f115ec80-7d96-4386-afa4-36d6ee36c6c3 {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:10:43.766330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f189a9c615b6456da780a1d3f0236002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1ec39b900ce4576980ee0f86b2cbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:10:43.774362 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-18051949-8917-43a6-a1ff-6876f7543bc6 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 200 len: 1309 microversion: 2.1 time: 0.104591 Aug 30 00:10:43.774971 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 526/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:43 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:10:44.795738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:10:44.796481 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] [instance: f115ec80-7d96-4386-afa4-36d6ee36c6c3] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:10:44.803774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:44.804264 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:44.804707 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:44.805403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:10:44.805863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:10:44.806292 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:10:44.819982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] HTTP exception thrown: Instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 could not be found. Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Request method failure captured: Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 HTTP/1.1 Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVURR7MyAAyF6Mh49d23MlTYs7sd1DpZVjQiQ-rzjolLbLyrTaEl0hm6Jw5EdFvr4tVzysYcNV_JPZBI9ySehfkmwR2zWRvAvALt25iVdhc7hgz7oAm69SVdNbfq86lRb7V82Fo-Fo1UTXqBZ6aPAEyp_nNuRGNChXdttS7wMELOF04 Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: b1ec39b900ce4576980ee0f86b2cbf5e Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1790642131 Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:10:44.821642 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b1ec39b900ce4576980ee0f86b2cbf5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b1ec39b900ce4576980ee0f86b2cbf5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1ec39b900ce4576980ee0f86b2cbf5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b1ec39b900ce4576980ee0f86b2cbf5e"}]}] Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-VolumesSnapshotTestJSON-1790642131 Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: b1ec39b900ce4576980ee0f86b2cbf5e Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1790642131 Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-VolumesSnapshotTestJSON-1790642131-project Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: f189a9c615b6456da780a1d3f0236002 Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-VolumesSnapshotTestJSON-1790642131-project Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 could not be found. Aug 30 00:10:44.823406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'f115ec80-7d96-4386-afa4-36d6ee36c6c3'} Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 could not be found. Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:10:44.824457 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 could not be found. Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 could not be found. Aug 30 00:10:44.825849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:10:44.827115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] Returning 404 to user: Instance f115ec80-7d96-4386-afa4-36d6ee36c6c3 could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:10:44.827115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-58ccffbe-0195-4add-be30-1160facb2232 tempest-VolumesSnapshotTestJSON-1790642131 tempest-VolumesSnapshotTestJSON-1790642131-project] 10.222.0.60 "GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3" status: 404 len: 111 microversion: 2.1 time: 0.031305 Aug 30 00:10:44.827115 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 564/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:10:44 2022] GET /compute/v2.1/servers/f115ec80-7d96-4386-afa4-36d6ee36c6c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:11:03.877243 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:03.877820 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:03.880272 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:03.880960 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:03.885612 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:03.886096 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:03.886560 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:03.887249 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:03.887703 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:03.888120 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:03.915127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:11:04.359561 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7c7fd370-184e-4ad4-afc2-d5eb510d6e14 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "DELETE /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 204 len: 0 microversion: 2.1 time: 0.486711 Aug 30 00:11:04.360292 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 527/1091] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:11:03 2022] DELETE /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:11:04.370131 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:04.373536 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:04.373536 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:04.374073 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:04.382390 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:04.382906 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:04.383606 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:04.384522 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:04.384982 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:04.385406 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:04.539190 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:04.547071 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-cc7fc13d-abb4-44c5-9d4c-0121ef5288eb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1575 microversion: 2.1 time: 0.182111 Aug 30 00:11:04.547639 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 565/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:04 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:05.568598 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:05.569301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:05.575897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:05.576382 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:05.576819 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:05.577506 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:05.577967 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:05.578418 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:05.728293 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:05.736092 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-fbd417d1-928d-4bf4-b769-e13ecc5b74f5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1575 microversion: 2.1 time: 0.171769 Aug 30 00:11:05.736657 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 528/1093] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:05 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:06.757976 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:06.758955 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:06.766214 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:06.766777 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:06.767669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:06.768382 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:06.768938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:06.769337 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:06.843245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:06.850338 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-675251ac-3787-42b7-ac8e-225cbc11bf01 req-1fe6f6eb-6e26-4831-9f42-7a0c6d88c63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574b6476-5eeb-4eac-be78-7632db94cc3d", "name": "network-vif-deleted", "tag": "ce2af983-4ada-48be-85de-0bb55d53e4c6"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:11:06.854652 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-1d29a05b-3f03-452e-acf5-3dded6bb06cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1508 microversion: 2.1 time: 0.101343 Aug 30 00:11:06.855297 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 566/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:06 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1508 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:06.871638 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-675251ac-3787-42b7-ac8e-225cbc11bf01 req-1fe6f6eb-6e26-4831-9f42-7a0c6d88c63c service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:06.878462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-675251ac-3787-42b7-ac8e-225cbc11bf01 req-1fe6f6eb-6e26-4831-9f42-7a0c6d88c63c service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:06.878462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-675251ac-3787-42b7-ac8e-225cbc11bf01 req-1fe6f6eb-6e26-4831-9f42-7a0c6d88c63c service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:06.890094 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-675251ac-3787-42b7-ac8e-225cbc11bf01 req-1fe6f6eb-6e26-4831-9f42-7a0c6d88c63c service nova] Creating event network-vif-deleted:ce2af983-4ada-48be-85de-0bb55d53e4c6 for instance 574b6476-5eeb-4eac-be78-7632db94cc3d on hv-cinder-85427 Aug 30 00:11:06.898433 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-675251ac-3787-42b7-ac8e-225cbc11bf01 req-1fe6f6eb-6e26-4831-9f42-7a0c6d88c63c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053135 Aug 30 00:11:06.899322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 529/1095] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:11:07.877544 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:07.878158 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:07.885307 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:07.885784 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:07.886223 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:07.886949 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:07.887398 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:07.887814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:07.919478 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:07.919881 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:07.920334 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:07.920774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.objects.instance [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lazy-loading 'fault' on Instance uuid 574b6476-5eeb-4eac-be78-7632db94cc3d {{(pid=127769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:11:07.966259 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:07.977453 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0ec57526-3af3-403a-9a81-b313b11fb9bd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 200 len: 1228 microversion: 2.1 time: 0.104075 Aug 30 00:11:07.987912 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 567/1096] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:07 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 1228 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:09.000515 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:09.001119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:09.009457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:09.010446 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:09.010446 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:09.011103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:09.011551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:09.012260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:09.029510 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] HTTP exception thrown: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Request method failure captured: Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d HTTP/1.1 Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVTffh8Z-q4aGjr7yT0jSA6G_xKQrdum575RVMcu7Frk0VFUfcjvOganypsYsZhr9RVtLqaZhnei8C6dfQgHJ70cwWLvQQOkLMqY_k02qjySQp8-1MiiMvU3alXBGhBzFwCSa1SFmRAgJQ7fK0O9A_R0ZCVwortv36vHe2jo3CKvttU Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:11:09.032270 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}] Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-TestVolumeBootPattern-849399878 Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: ca4e4437fa0c4b03ac2f8c3d2aa1589f Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:11:09.033807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '574b6476-5eeb-4eac-be78-7632db94cc3d'} Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:11:09.035624 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:11:09.037754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:11:09.040348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Returning 404 to user: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:11:09.040348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-22c2257a-dd18-4187-a6c7-7cfa10107d1f tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 404 len: 111 microversion: 2.1 time: 0.038210 Aug 30 00:11:09.040348 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 530/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:08 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:11:09.146533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-428665078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-870002560", "security_groups": [{"name": "tempest-secgroup-smoke-733249467"}], "block_device_mapping_v2": [{"uuid": "4874a7ec-755e-46ef-b94e-0578d064eb01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8319b568-7e64-4b20-bb37-86ff7df63aca"}]}} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:11:09.267742 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.network.neutron [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] validate_networks() for [('8319b568-7e64-4b20-bb37-86ff7df63aca', None, None, None, None, None)] {{(pid=127769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:11:09.654028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Flavor limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:11:09.654541 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Image limits 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:11:09.655015 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Flavor pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:11:09.655421 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Image pref 0:0:0 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:11:09.656008 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.virt.hardware [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:11:09.669305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:09.670181 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:09.670691 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:09.671430 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:09.671919 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:09.672346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:09.689866 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:11:09.693899 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.quota [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for user ca4e4437fa0c4b03ac2f8c3d2aa1589f and project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'cores', 'ram', 'instances'} {{(pid=127769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:11:09.752612 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Going to run 1 instances... {{(pid=127769) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:11:09.755020 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4874a7ec-755e-46ef-b94e-0578d064eb01',volume_size=None,volume_type=None)] {{(pid=127769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:11:10.824204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e167e928-29a2-4a87-939f-3925da71018d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.682199 Aug 30 00:11:10.824880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 568/1098] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:11:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:11:10.835590 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-4caa657c-29cf-41ca-9027-5faa85b8d619 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:10.836320 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-4caa657c-29cf-41ca-9027-5faa85b8d619 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:10.890754 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-4caa657c-29cf-41ca-9027-5faa85b8d619 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:10.897539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-4caa657c-29cf-41ca-9027-5faa85b8d619 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1093 microversion: 2.1 time: 0.065861 Aug 30 00:11:10.898102 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 531/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:10 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:11.918399 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-0063b252-b84f-4e2a-a199-7bf8caa5ecd6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:11.919042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-0063b252-b84f-4e2a-a199-7bf8caa5ecd6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:11.974132 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-0063b252-b84f-4e2a-a199-7bf8caa5ecd6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:11.981096 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-0063b252-b84f-4e2a-a199-7bf8caa5ecd6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1093 microversion: 2.1 time: 0.066664 Aug 30 00:11:11.981685 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 569/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:11 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:13.001910 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5dc1cb16-c571-487c-973e-1026ea0e1137 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:13.002514 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5dc1cb16-c571-487c-973e-1026ea0e1137 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:13.056765 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5dc1cb16-c571-487c-973e-1026ea0e1137 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:13.063577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5dc1cb16-c571-487c-973e-1026ea0e1137 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1093 microversion: 2.1 time: 0.066240 Aug 30 00:11:13.064152 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 532/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:12 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:14.084609 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-50e424c5-b691-4bdd-9032-fb314bb37abc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:14.085226 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-50e424c5-b691-4bdd-9032-fb314bb37abc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:14.141494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-50e424c5-b691-4bdd-9032-fb314bb37abc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:14.148018 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-50e424c5-b691-4bdd-9032-fb314bb37abc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1093 microversion: 2.1 time: 0.067205 Aug 30 00:11:14.149078 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 570/1102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:14 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:15.169332 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:15.169893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:15.176451 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:15.176939 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:15.177375 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:15.178069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:15.178546 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:15.178975 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:15.239417 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:15.247049 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-acbbfc02-73b9-4274-a679-d01bf557effc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1143 microversion: 2.1 time: 0.081698 Aug 30 00:11:15.247615 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 533/1103] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:15 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:16.268501 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:16.269052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:16.276268 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:16.276755 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:16.277193 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:16.277904 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:16.278346 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:16.278800 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:16.339233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:16.346894 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7b07dd87-eb70-4495-9fe0-c72604c09c13 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1143 microversion: 2.1 time: 0.082957 Aug 30 00:11:16.347490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 571/1104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:16 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:17.367504 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:17.368093 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:17.374605 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:17.375099 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:17.375533 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:17.376224 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:17.376677 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:17.377098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:17.440091 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:17.448186 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5a4f2b33-398d-424f-9ed6-4e75f7e438ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1191 microversion: 2.1 time: 0.084642 Aug 30 00:11:17.448763 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 534/1105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:17 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:18.477105 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:18.477105 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:18.477105 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:18.477878 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:18.478052 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:18.478795 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:18.479256 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:18.479750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:18.545021 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:18.553701 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-16256607-b43c-4a1a-b424-5c7e814cd317 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1209 microversion: 2.1 time: 0.088059 Aug 30 00:11:18.559722 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 572/1106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:18 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:19.574714 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:19.575325 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:19.582310 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:19.587022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:19.587022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:19.587022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:19.587022 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:19.587423 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:19.705546 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-54919328-3ca5-4c2c-a894-64b563c2201a req-cb1937d5-767c-4871-ac31-3296f942dbad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e6f8c-fe20-4922-87d5-cd8bf1425d2e", "tag": "c0874064-5626-4880-980d-1a2784fe47e1"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:11:19.711437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:19.716930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-54919328-3ca5-4c2c-a894-64b563c2201a req-cb1937d5-767c-4871-ac31-3296f942dbad service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:19.717413 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-54919328-3ca5-4c2c-a894-64b563c2201a req-cb1937d5-767c-4871-ac31-3296f942dbad service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:19.717849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-54919328-3ca5-4c2c-a894-64b563c2201a req-cb1937d5-767c-4871-ac31-3296f942dbad service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:19.729558 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-54919328-3ca5-4c2c-a894-64b563c2201a req-cb1937d5-767c-4871-ac31-3296f942dbad service nova] Creating event network-changed:c0874064-5626-4880-980d-1a2784fe47e1 for instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e on hv-cinder-85427 Aug 30 00:11:19.734621 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-54919328-3ca5-4c2c-a894-64b563c2201a req-cb1937d5-767c-4871-ac31-3296f942dbad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034183 Aug 30 00:11:19.735224 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 573/1107] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:11:19.767416 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:19.775233 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-836f5f71-4298-419b-a331-72874a777cec tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1276 microversion: 2.1 time: 0.204436 Aug 30 00:11:19.775814 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 535/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:19 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:20.796965 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:20.797669 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:20.805520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:20.806001 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:20.806441 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:20.807162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:20.807621 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:20.808048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:20.942730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:20.950498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-58aa64ed-6694-419a-8682-dcdea9b6cf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.157765 Aug 30 00:11:20.951060 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 574/1109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:20 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:21.971951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:21.972565 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:21.979043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:21.984539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:21.984539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:21.984539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:21.984539 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:21.984983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:22.116455 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:22.124168 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-c6cfb2ee-fe83-46ab-a318-29aef409fca5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.156211 Aug 30 00:11:22.124729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 536/1110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:21 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:23.144788 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:23.145403 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:23.152579 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:23.153059 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:23.153494 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:23.154184 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:23.154683 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:23.155110 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:23.286672 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:23.294397 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d4798eec-7821-4a67-9c62-8618e7c62c78 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.153443 Aug 30 00:11:23.295003 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 575/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:23 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:24.316119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:24.316818 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:24.319322 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=4 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:24.324073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:24.324561 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:24.324983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:24.325669 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:24.326119 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:24.326577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:24.457100 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:24.464727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8f57dd1d-e10d-4e1b-ade5-4e36cffa3da5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.153080 Aug 30 00:11:24.465297 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 537/1112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:24 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:25.484979 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:25.485586 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:25.487555 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=10 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:25.492792 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:25.493272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:25.493697 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:25.494382 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:25.494854 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:25.496262 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:25.641819 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:25.649481 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-4752c7fd-755b-4baa-917f-f83141e4c3dd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.168462 Aug 30 00:11:25.650046 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 576/1113] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:25 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:26.670614 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:26.671221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:26.678155 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:26.678657 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:26.679087 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:26.679790 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:26.680235 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:26.680655 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:26.811140 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:26.818849 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-11987816-8592-4769-b16d-c9cd3dbb6047 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.152163 Aug 30 00:11:26.819441 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 538/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:26 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:27.839305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:27.839849 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:27.846171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:27.846679 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:27.847110 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:27.847786 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:27.848233 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:27.848651 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:27.979431 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:27.987614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a409cf87-3167-4721-a8a5-f459431766a9 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.152213 Aug 30 00:11:27.988171 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 577/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:27 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:29.009748 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:29.010402 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:29.017169 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:29.017728 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:29.018169 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:29.019029 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:29.019492 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:29.020035 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:29.161173 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:29.169953 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9c630649-1a05-4b6c-92e1-02522817a442 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.164461 Aug 30 00:11:29.170544 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 539/1116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:29 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:29.366828 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-25ac45d3-9541-450b-835c-25fd5d6d28f1 req-18702ebb-6867-4d67-843d-0b59a1f5dd9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e6f8c-fe20-4922-87d5-cd8bf1425d2e", "name": "network-vif-plugged", "status": "completed", "tag": "c0874064-5626-4880-980d-1a2784fe47e1"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:11:29.377091 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-25ac45d3-9541-450b-835c-25fd5d6d28f1 req-18702ebb-6867-4d67-843d-0b59a1f5dd9f service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:29.377449 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-25ac45d3-9541-450b-835c-25fd5d6d28f1 req-18702ebb-6867-4d67-843d-0b59a1f5dd9f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:29.378247 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-25ac45d3-9541-450b-835c-25fd5d6d28f1 req-18702ebb-6867-4d67-843d-0b59a1f5dd9f service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:29.390064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-25ac45d3-9541-450b-835c-25fd5d6d28f1 req-18702ebb-6867-4d67-843d-0b59a1f5dd9f service nova] Creating event network-vif-plugged:c0874064-5626-4880-980d-1a2784fe47e1 for instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e on hv-cinder-85427 Aug 30 00:11:29.396142 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-25ac45d3-9541-450b-835c-25fd5d6d28f1 req-18702ebb-6867-4d67-843d-0b59a1f5dd9f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210863 Aug 30 00:11:29.396885 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 578/1117] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:11:30.191476 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:30.192089 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:30.198401 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:30.198917 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:30.199347 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:30.200025 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:30.200475 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:30.200893 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:30.333205 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:30.341378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-3d795cb4-c11e-483e-a373-e823e7c0231d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1264 microversion: 2.1 time: 0.154248 Aug 30 00:11:30.341952 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 540/1118] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:30 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:31.363934 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:31.364546 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:31.370824 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:31.371305 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:31.371738 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:31.372427 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:31.372877 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:31.373300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:31.501050 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:31.509049 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-017aa2c1-fd15-4d78-97d0-8488b2fa1eaa tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1452 microversion: 2.1 time: 0.150231 Aug 30 00:11:31.509607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 579/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:31 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:31.529843 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:11:31.530493 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:11:31.537372 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:31.537854 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:31.538292 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:31.539001 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:31.539457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:31.539881 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:31.668759 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:11:31.676413 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-2dd412f8-6370-4e16-867d-09bcc0aa3602 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1452 microversion: 2.1 time: 0.150476 Aug 30 00:11:31.676987 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 541/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:11:31 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:11:33.637883 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-9e68d661-354c-4fef-8d8a-c00782ce0ee0 req-02c13674-eb95-41cc-9f56-24a00cb1f1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e6f8c-fe20-4922-87d5-cd8bf1425d2e", "tag": "c0874064-5626-4880-980d-1a2784fe47e1"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:11:33.648533 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-9e68d661-354c-4fef-8d8a-c00782ce0ee0 req-02c13674-eb95-41cc-9f56-24a00cb1f1ae service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:11:33.648939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-9e68d661-354c-4fef-8d8a-c00782ce0ee0 req-02c13674-eb95-41cc-9f56-24a00cb1f1ae service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:11:33.649364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-9e68d661-354c-4fef-8d8a-c00782ce0ee0 req-02c13674-eb95-41cc-9f56-24a00cb1f1ae service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:11:33.660814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-9e68d661-354c-4fef-8d8a-c00782ce0ee0 req-02c13674-eb95-41cc-9f56-24a00cb1f1ae service nova] Creating event network-changed:c0874064-5626-4880-980d-1a2784fe47e1 for instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e on hv-cinder-85427 Aug 30 00:11:33.665633 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-9e68d661-354c-4fef-8d8a-c00782ce0ee0 req-02c13674-eb95-41cc-9f56-24a00cb1f1ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031527 Aug 30 00:11:33.666631 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 580/1121] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:13:10.672830 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:10.673583 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:10.674819 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 00:13:10.674970 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Tue Aug 30 00:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 30 00:13:10.676195 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:13:10.676343 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Tue Aug 30 00:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Aug 30 00:13:10.681207 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1392338408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-870002560", "security_groups": [{"name": "tempest-secgroup-smoke-733249467"}], "block_device_mapping_v2": [{"uuid": "5586fbc5-2b04-4c94-a4dc-7e07dc7f67af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8319b568-7e64-4b20-bb37-86ff7df63aca"}]}} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:13:10.797966 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.network.neutron [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] validate_networks() for [('8319b568-7e64-4b20-bb37-86ff7df63aca', None, None, None, None, None)] {{(pid=127768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:13:11.271321 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Flavor limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:13:11.271741 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Image limits 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:13:11.272206 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Flavor pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:13:11.272610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Image pref 0:0:0 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:13:11.273018 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.virt.hardware [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:13:11.281777 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:11.282247 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:11.282717 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:11.283445 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:11.283897 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:11.284843 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:11.301740 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:13:11.305591 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.quota [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Getting quotas for user ca4e4437fa0c4b03ac2f8c3d2aa1589f and project 09a2136c4af742b39071e0b2bc8565c3. Resources: {'cores', 'ram', 'instances'} {{(pid=127768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:13:11.361814 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Going to run 1 instances... {{(pid=127768) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:13:11.364497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5586fbc5-2b04-4c94-a4dc-7e07dc7f67af',volume_size=None,volume_type=None)] {{(pid=127768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:13:12.236489 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-dc9c98ab-ae08-40db-b3ae-353802377bab tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.565487 Aug 30 00:13:12.237200 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 542/1122] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 30 00:13:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 00:13:12.247082 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:12.247892 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=70 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:12.249396 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 00:13:12.249589 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Tue Aug 30 00:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c (ip 10.222.0.60) !!! Aug 30 00:13:12.256408 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-d0cb16a0-e18d-4187-b2ee-20eb33322a2d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:12.281377 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-d0cb16a0-e18d-4187-b2ee-20eb33322a2d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:12.315139 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-d0cb16a0-e18d-4187-b2ee-20eb33322a2d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:12.322766 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-d0cb16a0-e18d-4187-b2ee-20eb33322a2d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1094 microversion: 2.1 time: 0.077963 Aug 30 00:13:12.323680 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 581/1123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:12 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:13.344047 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-a17aa910-d065-485a-ad70-139bc42f0c9d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:13.344640 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-a17aa910-d065-485a-ad70-139bc42f0c9d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:13.397686 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-a17aa910-d065-485a-ad70-139bc42f0c9d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:13.404488 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-a17aa910-d065-485a-ad70-139bc42f0c9d tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1094 microversion: 2.1 time: 0.065135 Aug 30 00:13:13.405049 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 543/1124] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:13 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:14.426343 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:14.426938 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:14.433963 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:14.434448 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:14.434916 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:14.435610 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:14.436096 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:14.436525 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:14.501300 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:14.509606 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7672a58a-61ac-497c-9e8b-c9cd3d2e730b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1144 microversion: 2.1 time: 0.088450 Aug 30 00:13:14.510179 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 582/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:14 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:15.532247 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:15.532851 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:15.539880 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:15.540352 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:15.540776 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:15.541469 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:15.541900 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:15.542317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:15.603643 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:15.611313 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-57260341-8c55-4b73-8100-7f96bc51aae8 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1136 microversion: 2.1 time: 0.083177 Aug 30 00:13:15.611866 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 544/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:15 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:16.633351 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:16.633994 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:16.640730 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:16.641210 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:16.641650 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:16.642340 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:16.642822 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:16.643245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:16.704128 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:16.712422 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-364e0521-8d52-41fe-85d8-e7ca0fb59d5e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1192 microversion: 2.1 time: 0.082958 Aug 30 00:13:16.713289 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 583/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:16 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:17.733078 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:17.741339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:17.741339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:17.741339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:17.741339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:17.741822 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:17.742103 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:17.742554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:17.803804 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:17.811650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-7fc1e89a-b4e1-4361-bc45-8c453618168e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1200 microversion: 2.1 time: 0.082537 Aug 30 00:13:17.812242 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 545/1128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:17 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:18.832568 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:18.833123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:18.839561 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:18.840064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:18.840473 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:18.841187 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:18.841661 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:18.842084 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:18.979826 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:18.988204 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-847bb05c-d659-4642-859e-50ea31d355cc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1277 microversion: 2.1 time: 0.159172 Aug 30 00:13:18.988775 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 584/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:18 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:19.778317 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-0cab4c14-6246-4f1d-bbee-74240f7bc9d5 req-e35bbd57-b05d-49e6-8bb4-d6377b8bfa81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1efcd24a-3e04-4e2f-be4e-21198c76bb1c", "tag": "f1a36d57-f508-4ce2-9aed-8d366f181656"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:13:19.789784 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0cab4c14-6246-4f1d-bbee-74240f7bc9d5 req-e35bbd57-b05d-49e6-8bb4-d6377b8bfa81 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:19.790263 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0cab4c14-6246-4f1d-bbee-74240f7bc9d5 req-e35bbd57-b05d-49e6-8bb4-d6377b8bfa81 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:19.790727 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0cab4c14-6246-4f1d-bbee-74240f7bc9d5 req-e35bbd57-b05d-49e6-8bb4-d6377b8bfa81 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:19.801844 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-0cab4c14-6246-4f1d-bbee-74240f7bc9d5 req-e35bbd57-b05d-49e6-8bb4-d6377b8bfa81 service nova] Creating event network-changed:f1a36d57-f508-4ce2-9aed-8d366f181656 for instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c on hv-cinder-85427 Aug 30 00:13:19.806837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-0cab4c14-6246-4f1d-bbee-74240f7bc9d5 req-e35bbd57-b05d-49e6-8bb4-d6377b8bfa81 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032607 Aug 30 00:13:19.808020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 546/1130] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:13:20.008959 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:20.009655 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:20.016042 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:20.016520 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:20.016950 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:20.017704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:20.018156 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:20.018607 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:20.167507 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:20.174410 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2fc0c41d-0f83-41c2-8107-b3f90f7cfbc7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1277 microversion: 2.1 time: 0.169722 Aug 30 00:13:20.175240 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 585/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:20 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:21.195734 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:21.196432 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:21.202874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:21.203350 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:21.203783 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:21.204475 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:21.204932 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:21.205360 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:21.295345 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=2 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:21.344792 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:21.353332 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-8848cf13-97cc-467b-9160-5d26f9ed9dd7 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.162254 Aug 30 00:13:21.353951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 547/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:21 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:22.374941 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:22.375552 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:22.378735 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell0:SELECT=2 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:22.384293 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:22.384796 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:22.385432 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:22.386148 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:22.386631 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:22.387077 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:22.520560 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:22.528344 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e0761bcd-4050-4702-8de6-728a23dc22db tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.157450 Aug 30 00:13:22.528910 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 586/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:22 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:23.548873 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:23.549551 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:23.551860 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell0:SELECT=8 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:23.556606 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:23.557085 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:23.557559 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:23.558258 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:23.558732 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:23.559152 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:23.697621 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:23.705260 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-0826fb88-2da0-4156-8c6d-5b5be3140300 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.160613 Aug 30 00:13:23.705827 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 548/1134] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:23 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:24.727296 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:24.727933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:24.734312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:24.734815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:24.735251 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:24.735940 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:24.736392 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:24.736815 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:24.867162 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:24.874714 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-a6fae961-8cb6-4b4f-b86d-25cb74dcf5fc tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.151627 Aug 30 00:13:24.875275 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 587/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:24 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:25.895706 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:25.896247 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:25.902623 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:25.903098 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:25.903524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:25.904201 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:25.904650 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:25.905069 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:26.039112 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:26.046723 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-98910a1a-ada9-4205-9922-aa3403deb356 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.155177 Aug 30 00:13:26.047301 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 549/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:25 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:27.069153 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:27.069807 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:27.076336 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:27.076814 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:27.077245 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:27.077922 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:27.078370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:27.078809 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:27.210338 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:27.217902 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-2dc37386-64a0-406a-a0f0-a51f451c68c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.153240 Aug 30 00:13:27.218460 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 588/1137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:27 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:28.238073 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:28.238807 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:28.245127 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:28.245610 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:28.246041 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:28.246764 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:28.247214 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:28.247635 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:28.375661 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:28.384176 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-b6cfbbf4-a4f4-4901-a818-64b5e4fcf847 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.150041 Aug 30 00:13:28.384750 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 550/1138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:28 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:29.405575 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:29.406272 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:29.413389 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:29.413871 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:29.414309 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:29.415041 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:29.415503 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:29.415930 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:29.550349 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:29.558101 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-ab7486c2-84f6-496c-991c-00ec9a8f9d61 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.156434 Aug 30 00:13:29.558696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 589/1139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:29 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:29.777466 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-52da274b-508f-4413-9a40-04f45ca6c39a req-53d39068-2a71-4090-9800-b018a82e97b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1efcd24a-3e04-4e2f-be4e-21198c76bb1c", "name": "network-vif-plugged", "status": "completed", "tag": "f1a36d57-f508-4ce2-9aed-8d366f181656"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:13:29.787930 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-52da274b-508f-4413-9a40-04f45ca6c39a req-53d39068-2a71-4090-9800-b018a82e97b5 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:29.788404 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-52da274b-508f-4413-9a40-04f45ca6c39a req-53d39068-2a71-4090-9800-b018a82e97b5 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:29.788831 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-52da274b-508f-4413-9a40-04f45ca6c39a req-53d39068-2a71-4090-9800-b018a82e97b5 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:29.800822 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-52da274b-508f-4413-9a40-04f45ca6c39a req-53d39068-2a71-4090-9800-b018a82e97b5 service nova] Creating event network-vif-plugged:f1a36d57-f508-4ce2-9aed-8d366f181656 for instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c on hv-cinder-85427 Aug 30 00:13:29.805868 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-52da274b-508f-4413-9a40-04f45ca6c39a req-53d39068-2a71-4090-9800-b018a82e97b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032252 Aug 30 00:13:29.806459 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 551/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:13:30.578455 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:30.579084 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:30.585051 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:30.585526 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:30.585956 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:30.586682 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:30.587323 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:30.587750 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:30.719886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:30.728900 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-7cf4e2df-b7bb-485f-907f-d8846a8d87a6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1265 microversion: 2.1 time: 0.154471 Aug 30 00:13:30.731286 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 590/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:30 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:31.749693 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:31.750385 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:31.757874 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:31.758347 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:31.758837 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:31.759505 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:31.759949 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:31.760372 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:31.896468 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:31.904187 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6fcc2779-a9bd-486a-ae6a-921663c82fc6 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1452 microversion: 2.1 time: 0.158716 Aug 30 00:13:31.904760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 552/1142] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:31 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:31.924195 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:13:31.924806 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:13:31.931873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:31.932354 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:31.932790 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:31.933479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:31.933939 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:31.934365 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:32.063123 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:13:32.071442 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-298631e0-195a-4d92-8d8a-0ed87e5195bf tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1452 microversion: 2.1 time: 0.151352 Aug 30 00:13:32.072034 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 591/1143] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:13:31 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:13:34.590434 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-30a3fbd6-b6eb-4b76-8a4b-d8da0e6145bf req-b011eba8-1e31-4a7f-bc71-a0cfcf319903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1efcd24a-3e04-4e2f-be4e-21198c76bb1c", "tag": "f1a36d57-f508-4ce2-9aed-8d366f181656"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:13:34.600011 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-30a3fbd6-b6eb-4b76-8a4b-d8da0e6145bf req-b011eba8-1e31-4a7f-bc71-a0cfcf319903 service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:13:34.600491 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-30a3fbd6-b6eb-4b76-8a4b-d8da0e6145bf req-b011eba8-1e31-4a7f-bc71-a0cfcf319903 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:13:34.600928 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-30a3fbd6-b6eb-4b76-8a4b-d8da0e6145bf req-b011eba8-1e31-4a7f-bc71-a0cfcf319903 service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:13:34.611800 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-30a3fbd6-b6eb-4b76-8a4b-d8da0e6145bf req-b011eba8-1e31-4a7f-bc71-a0cfcf319903 service nova] Creating event network-changed:f1a36d57-f508-4ce2-9aed-8d366f181656 for instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c on hv-cinder-85427 Aug 30 00:13:34.616877 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-30a3fbd6-b6eb-4b76-8a4b-d8da0e6145bf req-b011eba8-1e31-4a7f-bc71-a0cfcf319903 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030264 Aug 30 00:13:34.617498 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 553/1144] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:15:02.716609 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_api:SELECT=24 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:02.717414 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG dbcounter [-] [127769] Writing DB stats nova_cell1:SELECT=60 {{(pid=127769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:02.718517 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:15:02.718663 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Tue Aug 30 00:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c (ip 10.222.0.60) !!! Aug 30 00:15:02.720185 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:02.721490 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:15:02.721863 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Tue Aug 30 00:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c (ip 10.222.0.60) !!! Aug 30 00:15:02.721983 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG dbcounter [-] [127768] Writing DB stats nova_cell1:SELECT=50 {{(pid=127768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:02.727036 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:02.747904 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-0d65702c-b3a0-4eda-a204-14facd8b90a8 req-2cafdcd1-7c81-4e44-b79d-63e4f9cc78bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1efcd24a-3e04-4e2f-be4e-21198c76bb1c", "tag": "f1a36d57-f508-4ce2-9aed-8d366f181656"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:15:02.748103 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:02.748218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0d65702c-b3a0-4eda-a204-14facd8b90a8 req-2cafdcd1-7c81-4e44-b79d-63e4f9cc78bc service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:02.748218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0d65702c-b3a0-4eda-a204-14facd8b90a8 req-2cafdcd1-7c81-4e44-b79d-63e4f9cc78bc service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:02.748218 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-0d65702c-b3a0-4eda-a204-14facd8b90a8 req-2cafdcd1-7c81-4e44-b79d-63e4f9cc78bc service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:02.748504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:02.748504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:02.748504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:02.748504 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:02.748840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:02.748840 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:02.750234 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-0d65702c-b3a0-4eda-a204-14facd8b90a8 req-2cafdcd1-7c81-4e44-b79d-63e4f9cc78bc service nova] Creating event network-changed:f1a36d57-f508-4ce2-9aed-8d366f181656 for instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c on hv-cinder-85427 Aug 30 00:15:02.755702 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-0d65702c-b3a0-4eda-a204-14facd8b90a8 req-2cafdcd1-7c81-4e44-b79d-63e4f9cc78bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038030 Aug 30 00:15:02.756305 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 554/1145] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:15:02.778151 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Going to try to terminate instance {{(pid=127769) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:15:03.282697 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-8cc068da-b806-4223-aa71-e0268d69165c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 204 len: 0 microversion: 2.1 time: 0.567991 Aug 30 00:15:03.286498 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 592/1146] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:15:02 2022] DELETE /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:15:03.295182 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:03.295760 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:03.302895 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:03.303378 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:03.303810 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:03.304504 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:03.304951 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:03.305394 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:03.524772 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:15:03.532722 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-338b787b-c5a7-4362-893f-3ccc9b75e4cb tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1576 microversion: 2.1 time: 0.244846 Aug 30 00:15:03.533312 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 555/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:03 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:15:04.554366 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:04.555221 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:04.562416 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:04.564602 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:04.564602 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:04.564602 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:04.565028 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:04.565250 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:04.750608 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:15:04.758753 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5b72f77d-c7b0-43b9-99b5-2fa85ab55b46 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1458 microversion: 2.1 time: 0.208663 Aug 30 00:15:04.759315 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 593/1148] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:04 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1458 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:15:05.357085 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [req-8bd7fb82-766c-4121-80c7-43d4d789e67b req-ee08f8f7-359c-45f6-b3a9-730f2934015a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1efcd24a-3e04-4e2f-be4e-21198c76bb1c", "name": "network-vif-deleted", "tag": "f1a36d57-f508-4ce2-9aed-8d366f181656"}]} {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:15:05.367894 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-8bd7fb82-766c-4121-80c7-43d4d789e67b req-ee08f8f7-359c-45f6-b3a9-730f2934015a service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:05.368370 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-8bd7fb82-766c-4121-80c7-43d4d789e67b req-ee08f8f7-359c-45f6-b3a9-730f2934015a service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:05.368796 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [req-8bd7fb82-766c-4121-80c7-43d4d789e67b req-ee08f8f7-359c-45f6-b3a9-730f2934015a service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:05.380502 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.compute.server_external_events [req-8bd7fb82-766c-4121-80c7-43d4d789e67b req-ee08f8f7-359c-45f6-b3a9-730f2934015a service nova] Creating event network-vif-deleted:f1a36d57-f508-4ce2-9aed-8d366f181656 for instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c on hv-cinder-85427 Aug 30 00:15:05.386219 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [req-8bd7fb82-766c-4121-80c7-43d4d789e67b req-ee08f8f7-359c-45f6-b3a9-730f2934015a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Aug 30 00:15:05.386853 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 556/1149] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:15:05.780323 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:05.780933 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:05.787704 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:05.788182 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:05.788631 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:05.789330 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:05.789781 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:05.790212 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:06.096332 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:15:06.104303 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-e050ce47-8d0b-4791-a189-89554318588b tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1225 microversion: 2.1 time: 0.327964 Aug 30 00:15:06.104873 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 594/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:05 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1225 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:15:07.126445 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:07.127659 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:07.133806 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:07.134294 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:07.134761 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:07.135457 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:07.135913 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:07.136341 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:07.167194 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:07.167672 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:07.168109 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:07.168554 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.objects.instance [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lazy-loading 'fault' on Instance uuid 1efcd24a-3e04-4e2f-be4e-21198c76bb1c {{(pid=127768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:15:07.209906 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:15:07.217646 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-ea6a7c99-05b6-4248-9fd1-362c4a0c91cd tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 200 len: 1230 microversion: 2.1 time: 0.096172 Aug 30 00:15:07.218223 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 557/1151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:07 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:15:08.239007 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:08.239629 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 1efcd24a-3e04-4e2f-be4e-21198c76bb1c] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:08.246121 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:08.246634 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:08.247074 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:08.247763 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:08.248218 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:08.248644 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:08.262624 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] HTTP exception thrown: Instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c could not be found. Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Request method failure captured: Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c HTTP/1.1 Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVTffh8Z-q4aGjr7yT0jSA6G_xKQrdum575RVMcu7Frk0VFUfcjvOganypsYsZhr9RVtLqaZhnei8C6dfQgHJ70cwWLvQQOkLMqY_k02qjySQp8-1MiiMvU3alXBGhBzFwCSa1SFmRAgJQ7fK0O9A_R0ZCVwortv36vHe2jo3CKvttU Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:15:08.264244 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}] Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: ca4e4437fa0c4b03ac2f8c3d2aa1589f Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c could not be found. Aug 30 00:15:08.266013 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '1efcd24a-3e04-4e2f-be4e-21198c76bb1c'} Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c could not be found. Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:15:08.267064 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c could not be found. Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c could not be found. Aug 30 00:15:08.268789 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:08.270312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Returning 404 to user: Instance 1efcd24a-3e04-4e2f-be4e-21198c76bb1c could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:15:08.270312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-981ed06b-44c0-4de3-ae38-dd6a42fabf27 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c" status: 404 len: 111 microversion: 2.1 time: 0.031106 Aug 30 00:15:08.270312 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 595/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:08 2022] GET /compute/v2.1/servers/1efcd24a-3e04-4e2f-be4e-21198c76bb1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:15:11.825852 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:11.826369 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:11.828768 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-303d69fe-5e2a-4b6e-a2da-7cd262f094eb req-17d53c7b-8ff5-44d8-983d-e86ddf9f15ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e6f8c-fe20-4922-87d5-cd8bf1425d2e", "tag": "c0874064-5626-4880-980d-1a2784fe47e1"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:15:11.833117 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:11.833805 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:11.835059 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:11.836062 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:11.836729 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:11.837501 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:11.841774 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-303d69fe-5e2a-4b6e-a2da-7cd262f094eb req-17d53c7b-8ff5-44d8-983d-e86ddf9f15ae service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:11.842364 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-303d69fe-5e2a-4b6e-a2da-7cd262f094eb req-17d53c7b-8ff5-44d8-983d-e86ddf9f15ae service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:11.842886 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-303d69fe-5e2a-4b6e-a2da-7cd262f094eb req-17d53c7b-8ff5-44d8-983d-e86ddf9f15ae service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:11.857835 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-303d69fe-5e2a-4b6e-a2da-7cd262f094eb req-17d53c7b-8ff5-44d8-983d-e86ddf9f15ae service nova] Creating event network-changed:c0874064-5626-4880-980d-1a2784fe47e1 for instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e on hv-cinder-85427 Aug 30 00:15:11.864437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-303d69fe-5e2a-4b6e-a2da-7cd262f094eb req-17d53c7b-8ff5-44d8-983d-e86ddf9f15ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038442 Aug 30 00:15:11.864437 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 596/1153] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:15:11.866210 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Going to try to terminate instance {{(pid=127768) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:15:12.218773 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-12981b05-25fa-4ce2-affb-43f4c784432c tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 204 len: 0 microversion: 2.1 time: 0.396564 Aug 30 00:15:12.241519 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 558/1154] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:15:11 2022] DELETE /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:15:12.242048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:12.242048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:12.242048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:12.242048 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:12.242444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:12.242444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:12.242444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:12.242444 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:12.375787 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.policy [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127769) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:15:12.383880 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-b6e9a39e-a809-49f1-9f98-1962964e2de1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1576 microversion: 2.1 time: 0.159415 Aug 30 00:15:12.384447 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 597/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:12 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:15:13.409400 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:13.410155 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:13.417518 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:13.418020 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:13.418462 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:13.419221 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:13.419677 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:13.420104 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:13.560333 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:15:13.568775 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-d8fd2250-ffa0-4bea-816d-7eb4e39f89d5 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1458 microversion: 2.1 time: 0.167389 Aug 30 00:15:13.569349 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 559/1156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:13 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1458 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:15:14.233547 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [req-7debbe15-f588-43bf-8b1e-fb3b56c3c173 req-c7103946-75e7-45c4-9400-b35151cf85cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e6f8c-fe20-4922-87d5-cd8bf1425d2e", "name": "network-vif-deleted", "tag": "c0874064-5626-4880-980d-1a2784fe47e1"}]} {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:15:14.243479 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7debbe15-f588-43bf-8b1e-fb3b56c3c173 req-c7103946-75e7-45c4-9400-b35151cf85cb service nova] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:14.243953 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7debbe15-f588-43bf-8b1e-fb3b56c3c173 req-c7103946-75e7-45c4-9400-b35151cf85cb service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:14.245281 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [req-7debbe15-f588-43bf-8b1e-fb3b56c3c173 req-c7103946-75e7-45c4-9400-b35151cf85cb service nova] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:14.255719 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.compute.server_external_events [req-7debbe15-f588-43bf-8b1e-fb3b56c3c173 req-c7103946-75e7-45c4-9400-b35151cf85cb service nova] Creating event network-vif-deleted:c0874064-5626-4880-980d-1a2784fe47e1 for instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e on hv-cinder-85427 Aug 30 00:15:14.260619 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [req-7debbe15-f588-43bf-8b1e-fb3b56c3c173 req-c7103946-75e7-45c4-9400-b35151cf85cb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030779 Aug 30 00:15:14.261196 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 598/1157] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 30 00:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:15:14.589303 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:14.589906 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:14.596577 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:14.597087 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:14.597514 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:14.598222 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:14.598719 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:14.599148 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:14.663524 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.policy [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e4437fa0c4b03ac2f8c3d2aa1589f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a2136c4af742b39071e0b2bc8565c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127768) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:15:14.671330 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-9e4b27ce-7dd1-4687-8150-575230dfe82e tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 200 len: 1224 microversion: 2.1 time: 0.086002 Aug 30 00:15:14.671908 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 560/1158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:14 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:15:15.692925 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:15.693573 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: a43e6f8c-fe20-4922-87d5-cd8bf1425d2e] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:15.699834 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:15.700323 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:15.700761 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:15.701450 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:15.701905 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:15.702331 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:15.715985 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] HTTP exception thrown: Instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e could not be found. Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Request method failure captured: Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e HTTP/1.1 Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVTffh8Z-q4aGjr7yT0jSA6G_xKQrdum575RVMcu7Frk0VFUfcjvOganypsYsZhr9RVtLqaZhnei8C6dfQgHJ70cwWLvQQOkLMqY_k02qjySQp8-1MiiMvU3alXBGhBzFwCSa1SFmRAgJQ7fK0O9A_R0ZCVwortv36vHe2jo3CKvttU Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:15:15.717594 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}] Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: ca4e4437fa0c4b03ac2f8c3d2aa1589f Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e could not be found. Aug 30 00:15:15.719370 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': 'a43e6f8c-fe20-4922-87d5-cd8bf1425d2e'} Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e could not be found. Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:15:15.720954 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e could not be found. Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e could not be found. Aug 30 00:15:15.722614 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:15.724110 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Returning 404 to user: Instance a43e6f8c-fe20-4922-87d5-cd8bf1425d2e could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:15:15.724110 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-5473d662-fe76-48c1-8b29-824b45cbc060 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e" status: 404 len: 111 microversion: 2.1 time: 0.031324 Aug 30 00:15:15.724110 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 599/1159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:15 2022] GET /compute/v2.1/servers/a43e6f8c-fe20-4922-87d5-cd8bf1425d2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:15:16.274914 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:16.275475 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.compute.api [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127768) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:16.281828 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:16.282303 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:16.282759 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:16.283466 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:16.283997 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:16.284497 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG oslo_concurrency.lockutils [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:16.297682 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.wsgi [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] HTTP exception thrown: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Request method failure captured: Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: request: DELETE /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d HTTP/1.1 Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept: application/json Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Accept-Encoding: identity Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Connection: close Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Length: 0 Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Content-Type: application/json Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Host: 10.222.0.60 Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: Openstack-System-Scope: None Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: User-Agent: python-urllib3/1.26.12 Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Auth-Token: gAAAAABjDVTffh8Z-q4aGjr7yT0jSA6G_xKQrdum575RVMcu7Frk0VFUfcjvOganypsYsZhr9RVtLqaZhnei8C6dfQgHJ70cwWLvQQOkLMqY_k02qjySQp8-1MiiMvU3alXBGhBzFwCSa1SFmRAgJQ7fK0O9A_R0ZCVwortv36vHe2jo3CKvttU Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Id: None Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Domain-Name: None Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Identity-Status: Confirmed Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Is-Admin-Project: True Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Id: default Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Domain-Name: Default Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Project-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Role: reader,member Aug 30 00:15:16.300549 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Roles: reader,member Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}] Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-Tenant-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Id: default Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Domain-Name: Default Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Id: ca4e4437fa0c4b03ac2f8c3d2aa1589f Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: X-User-Name: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: method: > Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: exception: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.302299 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: action_args: {'id': '574b6476-5eeb-4eac-be78-7632db94cc3d'} Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:15:16.303339 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.305053 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.311724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Returning 404 to user: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. {{(pid=127768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:15:16.311724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-6b5f9047-6b30-4be8-948a-462b43b084c1 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "DELETE /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 404 len: 111 microversion: 2.1 time: 0.031220 Aug 30 00:15:16.311724 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 561/1160] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 30 00:15:16 2022] DELETE /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:15:16.312062 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '>' {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:16.312062 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.compute.api [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] [instance: 574b6476-5eeb-4eac-be78-7632db94cc3d] Fetching instance by UUID {{(pid=127769) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:15:16.317766 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:16.318237 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:16.318696 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:16.319373 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Acquiring lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:15:16.319817 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:15:16.320231 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG oslo_concurrency.lockutils [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Lock "d03ce5c2-1a4b-434b-9dac-5218d9782043" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:15:16.333405 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.wsgi [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] HTTP exception thrown: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Request method failure captured: Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: request: GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d HTTP/1.1 Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept: application/json Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Accept-Encoding: identity Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Connection: close Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Length: 0 Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Content-Type: application/json Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Host: 10.222.0.60 Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: Openstack-System-Scope: None Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: User-Agent: python-urllib3/1.26.12 Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Auth-Token: gAAAAABjDVTffh8Z-q4aGjr7yT0jSA6G_xKQrdum575RVMcu7Frk0VFUfcjvOganypsYsZhr9RVtLqaZhnei8C6dfQgHJ70cwWLvQQOkLMqY_k02qjySQp8-1MiiMvU3alXBGhBzFwCSa1SFmRAgJQ7fK0O9A_R0ZCVwortv36vHe2jo3CKvttU Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Id: None Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Domain-Name: None Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Identity-Status: Confirmed Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Is-Admin-Project: True Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Id: default Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Domain-Name: Default Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Project-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Role: reader,member Aug 30 00:15:16.334926 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Roles: reader,member Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/09a2136c4af742b39071e0b2bc8565c3"}]}] Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Id: 09a2136c4af742b39071e0b2bc8565c3 Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-Tenant-Name: tempest-TestVolumeBootPattern-849399878 Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Id: default Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Domain-Name: Default Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Id: ca4e4437fa0c4b03ac2f8c3d2aa1589f Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: X-User-Name: tempest-TestVolumeBootPattern-849399878-project Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: method: > Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: exception: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.336675 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: action_args: {'id': '574b6476-5eeb-4eac-be78-7632db94cc3d'} Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: {{(pid=127769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:15:16.337591 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. Aug 30 00:15:16.339176 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: ERROR nova.api.openstack.wsgi Aug 30 00:15:16.340570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: DEBUG nova.api.openstack.wsgi [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Returning 404 to user: Instance 574b6476-5eeb-4eac-be78-7632db94cc3d could not be found. {{(pid=127769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:15:16.340570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: INFO nova.api.openstack.requestlog [None req-c159e554-6399-43fb-b6d9-dcfd1edecc53 tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d" status: 404 len: 111 microversion: 2.1 time: 0.029486 Aug 30 00:15:16.340570 dv-cinder-854273-4-iscsi devstack@n-api.service[127769]: [pid: 127769|app: 0|req: 600/1161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 30 00:15:16 2022] GET /compute/v2.1/servers/574b6476-5eeb-4eac-be78-7632db94cc3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:15:17.961429 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: DEBUG nova.api.openstack.wsgi [None req-5aa8b562-7119-4921-b935-3241bc4849ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] Calling method '.version_select at 0x7f09bf2764c0>' {{(pid=127768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:15:18.072043 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: INFO nova.api.openstack.requestlog [None req-5aa8b562-7119-4921-b935-3241bc4849ca tempest-TestVolumeBootPattern-849399878 tempest-TestVolumeBootPattern-849399878-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-870002560" status: 202 len: 0 microversion: 2.1 time: 0.114466 Aug 30 00:15:18.072694 dv-cinder-854273-4-iscsi devstack@n-api.service[127768]: [pid: 127768|app: 0|req: 562/1162] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Aug 30 00:15:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-870002560 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)